[==========] Running 7 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 5 tests from LeaderRebalancerTest
[ RUN ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260807 13:39:20.525657 21833 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.21.82.126:36399
I20260807 13:39:20.528544 21833 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:39:20.530303 21833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:39:20.566947 21839 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:39:20.567001 21840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:39:20.567657 21842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:39:21.860859 21841 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260807 13:39:21.861011 21833 server_base.cc:1029] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260807 13:39:21.866622 21833 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:39:21.867040 21833 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:39:21.867230 21833 hybrid_clock.cc:648] HybridClock initialized: now 1786109961867214 us; error 0 us; skew 500 ppm
I20260807 13:39:21.868510 21833 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:39:21.877331 21833 webserver.cc:460] Webserver started at http://127.21.82.126:33657/ using document root <none> and password file <none>
I20260807 13:39:21.878902 21833 fs_manager.cc:359] Metadata directory not provided
I20260807 13:39:21.879168 21833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:39:21.879845 21833 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:39:21.888336 21833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109960278411-21833-0/minicluster-data/master-0-root/instance:
uuid: "9a3ca23083684ea5b9c2d45167478623"
format_stamp: "Formatted at 2026-08-07 13:39:21 on dist-test-slave-3kk6"
I20260807 13:39:21.900012 21833 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.010s sys 0.001s
I20260807 13:39:21.907806 21849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:39:21.909603 21833 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.003s
I20260807 13:39:21.910084 21833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109960278411-21833-0/minicluster-data/master-0-root
uuid: "9a3ca23083684ea5b9c2d45167478623"
format_stamp: "Formatted at 2026-08-07 13:39:21 on dist-test-slave-3kk6"
I20260807 13:39:21.910506 21833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109960278411-21833-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109960278411-21833-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109960278411-21833-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:39:21.957672 21833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:39:21.959790 21833 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:39:21.960490 21833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:39:22.064816 21833 rpc_server.cc:307] RPC server started. Bound to: 127.21.82.126:36399
I20260807 13:39:22.064924 21922 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.82.126:36399 every 8 connection(s)
I20260807 13:39:22.077400 21923 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:22.112958 21923 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a3ca23083684ea5b9c2d45167478623: Bootstrap starting.
I20260807 13:39:22.121795 21923 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9a3ca23083684ea5b9c2d45167478623: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:22.124852 21923 log.cc:824] T 00000000000000000000000000000000 P 9a3ca23083684ea5b9c2d45167478623: Log is configured to *not* fsync() on all Append() calls
I20260807 13:39:22.131343 21923 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a3ca23083684ea5b9c2d45167478623: No bootstrap required, opened a new log
I20260807 13:39:22.159701 21923 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9a3ca23083684ea5b9c2d45167478623 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a3ca23083684ea5b9c2d45167478623" member_type: VOTER }
I20260807 13:39:22.160591 21923 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9a3ca23083684ea5b9c2d45167478623 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:22.160943 21923 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9a3ca23083684ea5b9c2d45167478623 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a3ca23083684ea5b9c2d45167478623, State: Initialized, Role: FOLLOWER
I20260807 13:39:22.162401 21923 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9a3ca23083684ea5b9c2d45167478623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a3ca23083684ea5b9c2d45167478623" member_type: VOTER }
I20260807 13:39:22.163167 21923 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9a3ca23083684ea5b9c2d45167478623 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 13:39:22.163538 21923 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9a3ca23083684ea5b9c2d45167478623 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 13:39:22.163959 21923 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9a3ca23083684ea5b9c2d45167478623 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:22.168532 21923 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9a3ca23083684ea5b9c2d45167478623 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a3ca23083684ea5b9c2d45167478623" member_type: VOTER }
I20260807 13:39:22.169764 21923 leader_election.cc:302] T 00000000000000000000000000000000 P 9a3ca23083684ea5b9c2d45167478623 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9a3ca23083684ea5b9c2d45167478623; no voters:
I20260807 13:39:22.172328 21923 leader_election.cc:288] T 00000000000000000000000000000000 P 9a3ca23083684ea5b9c2d45167478623 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 13:39:22.172729 21928 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9a3ca23083684ea5b9c2d45167478623 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:39:22.176600 21928 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9a3ca23083684ea5b9c2d45167478623 [term 1 LEADER]: Becoming Leader. State: Replica: 9a3ca23083684ea5b9c2d45167478623, State: Running, Role: LEADER
I20260807 13:39:22.177906 21928 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9a3ca23083684ea5b9c2d45167478623 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a3ca23083684ea5b9c2d45167478623" member_type: VOTER }
I20260807 13:39:22.179327 21923 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9a3ca23083684ea5b9c2d45167478623 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 13:39:22.195175 21930 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a3ca23083684ea5b9c2d45167478623 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9a3ca23083684ea5b9c2d45167478623. Latest consensus state: current_term: 1 leader_uuid: "9a3ca23083684ea5b9c2d45167478623" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a3ca23083684ea5b9c2d45167478623" member_type: VOTER } }
I20260807 13:39:22.196408 21930 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a3ca23083684ea5b9c2d45167478623 [sys.catalog]: This master's current role is: LEADER
I20260807 13:39:22.197057 21929 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a3ca23083684ea5b9c2d45167478623 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9a3ca23083684ea5b9c2d45167478623" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a3ca23083684ea5b9c2d45167478623" member_type: VOTER } }
I20260807 13:39:22.197559 21929 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a3ca23083684ea5b9c2d45167478623 [sys.catalog]: This master's current role is: LEADER
I20260807 13:39:22.200248 21942 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 13:39:22.218524 21942 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 13:39:22.227653 21833 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260807 13:39:22.242238 21942 catalog_manager.cc:1347] Generated new cluster ID: 4fd627a1954e4c739b1dbbd6d9972970
I20260807 13:39:22.242591 21942 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 13:39:22.272267 21942 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 13:39:22.274367 21942 catalog_manager.cc:1504] Loading token signing keys...
I20260807 13:39:22.295717 21942 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9a3ca23083684ea5b9c2d45167478623: Generated new TSK 0
I20260807 13:39:22.297279 21942 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 13:39:22.365010 21833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:39:22.377190 21957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:39:22.388316 21958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:39:22.389109 21961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:39:22.391016 21833 server_base.cc:1034] running on GCE node
I20260807 13:39:22.391848 21833 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:39:22.392050 21833 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:39:22.392257 21833 hybrid_clock.cc:648] HybridClock initialized: now 1786109962392227 us; error 0 us; skew 500 ppm
I20260807 13:39:22.392872 21833 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:39:22.397893 21833 webserver.cc:460] Webserver started at http://127.21.82.65:43421/ using document root <none> and password file <none>
I20260807 13:39:22.398495 21833 fs_manager.cc:359] Metadata directory not provided
I20260807 13:39:22.398754 21833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:39:22.399061 21833 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:39:22.400424 21833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109960278411-21833-0/minicluster-data/ts-0-root/instance:
uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
format_stamp: "Formatted at 2026-08-07 13:39:22 on dist-test-slave-3kk6"
I20260807 13:39:22.406597 21833 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260807 13:39:22.411559 21970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:39:22.412514 21833 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260807 13:39:22.412822 21833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109960278411-21833-0/minicluster-data/ts-0-root
uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
format_stamp: "Formatted at 2026-08-07 13:39:22 on dist-test-slave-3kk6"
I20260807 13:39:22.413141 21833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109960278411-21833-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109960278411-21833-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109960278411-21833-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:39:22.434307 21833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:39:22.436101 21833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:39:22.440133 21833 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 13:39:22.450465 21833 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:39:22.451216 21833 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.001s user 0.001s sys 0.000s
I20260807 13:39:22.451674 21833 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 13:39:22.451942 21833 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:39:22.778357 21833 rpc_server.cc:307] RPC server started. Bound to: 127.21.82.65:38001
I20260807 13:39:22.780099 22048 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.82.65:38001 every 8 connection(s)
I20260807 13:39:22.796434 21833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:39:22.824229 22057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:39:22.827611 22060 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:39:22.845212 22064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:39:22.846901 22050 heartbeater.cc:347] Connected to a master server at 127.21.82.126:36399
I20260807 13:39:22.847615 22050 heartbeater.cc:464] Registering TS with master...
I20260807 13:39:22.849606 22050 heartbeater.cc:511] Master 127.21.82.126:36399 requested a full tablet report, sending...
I20260807 13:39:22.849756 21833 server_base.cc:1034] running on GCE node
I20260807 13:39:22.850976 21833 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:39:22.851203 21833 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:39:22.851418 21833 hybrid_clock.cc:648] HybridClock initialized: now 1786109962851399 us; error 0 us; skew 500 ppm
I20260807 13:39:22.852207 21833 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:39:22.855616 21875 ts_manager.cc:194] Registered new tserver with Master: 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001)
I20260807 13:39:22.855940 21833 webserver.cc:460] Webserver started at http://127.21.82.66:34067/ using document root <none> and password file <none>
I20260807 13:39:22.856588 21833 fs_manager.cc:359] Metadata directory not provided
I20260807 13:39:22.856822 21833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:39:22.857124 21833 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:39:22.858366 21833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109960278411-21833-0/minicluster-data/ts-1-root/instance:
uuid: "7fa58ef028644655948f04747f2bde86"
format_stamp: "Formatted at 2026-08-07 13:39:22 on dist-test-slave-3kk6"
I20260807 13:39:22.861500 21875 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58426
I20260807 13:39:22.864573 21833 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260807 13:39:22.869745 22070 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:39:22.870859 21833 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 13:39:22.871160 21833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109960278411-21833-0/minicluster-data/ts-1-root
uuid: "7fa58ef028644655948f04747f2bde86"
format_stamp: "Formatted at 2026-08-07 13:39:22 on dist-test-slave-3kk6"
I20260807 13:39:22.871433 21833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109960278411-21833-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109960278411-21833-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109960278411-21833-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:39:22.893936 21833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:39:22.896436 21833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:39:22.904029 21833 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 13:39:22.912482 21833 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:39:22.912703 21833 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:39:22.913005 21833 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 13:39:22.913146 21833 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:39:23.244782 21833 rpc_server.cc:307] RPC server started. Bound to: 127.21.82.66:46193
I20260807 13:39:23.245895 22151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.82.66:46193 every 8 connection(s)
I20260807 13:39:23.268047 21833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 13:39:23.296944 22153 heartbeater.cc:347] Connected to a master server at 127.21.82.126:36399
I20260807 13:39:23.297793 22153 heartbeater.cc:464] Registering TS with master...
W20260807 13:39:23.307214 22160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:39:23.307128 22153 heartbeater.cc:511] Master 127.21.82.126:36399 requested a full tablet report, sending...
I20260807 13:39:23.312543 21875 ts_manager.cc:194] Registered new tserver with Master: 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193)
I20260807 13:39:23.316969 21875 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58442
W20260807 13:39:23.325608 22161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:39:23.332293 21833 server_base.cc:1034] running on GCE node
W20260807 13:39:23.332522 22165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:39:23.334281 21833 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:39:23.334474 21833 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:39:23.334713 21833 hybrid_clock.cc:648] HybridClock initialized: now 1786109963334696 us; error 0 us; skew 500 ppm
I20260807 13:39:23.335490 21833 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:39:23.339951 21833 webserver.cc:460] Webserver started at http://127.21.82.67:39637/ using document root <none> and password file <none>
I20260807 13:39:23.340847 21833 fs_manager.cc:359] Metadata directory not provided
I20260807 13:39:23.341190 21833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:39:23.341580 21833 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:39:23.343370 21833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109960278411-21833-0/minicluster-data/ts-2-root/instance:
uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
format_stamp: "Formatted at 2026-08-07 13:39:23 on dist-test-slave-3kk6"
I20260807 13:39:23.350571 21833 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260807 13:39:23.354625 22173 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:39:23.355581 21833 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 13:39:23.355899 21833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109960278411-21833-0/minicluster-data/ts-2-root
uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
format_stamp: "Formatted at 2026-08-07 13:39:23 on dist-test-slave-3kk6"
I20260807 13:39:23.356194 21833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109960278411-21833-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109960278411-21833-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109960278411-21833-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:39:23.391745 21833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:39:23.394357 21833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:39:23.396001 21833 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 13:39:23.402045 21833 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:39:23.402310 21833 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:39:23.402588 21833 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 13:39:23.402803 21833 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260807 13:39:23.681799 21833 rpc_server.cc:307] RPC server started. Bound to: 127.21.82.67:38271
I20260807 13:39:23.682960 22257 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.82.67:38271 every 8 connection(s)
I20260807 13:39:23.726161 22258 heartbeater.cc:347] Connected to a master server at 127.21.82.126:36399
I20260807 13:39:23.726871 22258 heartbeater.cc:464] Registering TS with master...
I20260807 13:39:23.728050 22258 heartbeater.cc:511] Master 127.21.82.126:36399 requested a full tablet report, sending...
I20260807 13:39:23.730921 21875 ts_manager.cc:194] Registered new tserver with Master: 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:23.731552 21833 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.029029296s
I20260807 13:39:23.734427 21875 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58456
I20260807 13:39:23.740278 21833 test_util.cc:268] Using random seed: 569058380
I20260807 13:39:23.840759 21875 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58464:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 13:39:23.848564 21875 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 13:39:23.869266 22050 heartbeater.cc:503] Master 127.21.82.126:36399 was elected leader, sending a full tablet report...
I20260807 13:39:24.094776 21999 tablet_service.cc:1467] Processing CreateTablet for tablet efede11e063a479a9064465add093ed7 (DEFAULT_TABLE table=test-workload [id=8b9f86e3378d462b95ba50454059b25a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260807 13:39:24.101887 21998 tablet_service.cc:1467] Processing CreateTablet for tablet e173a6d914a64a95badab506789de0fe (DEFAULT_TABLE table=test-workload [id=8b9f86e3378d462b95ba50454059b25a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260807 13:39:24.108727 21994 tablet_service.cc:1467] Processing CreateTablet for tablet e18532a632434a23ba646b0c9af99180 (DEFAULT_TABLE table=test-workload [id=8b9f86e3378d462b95ba50454059b25a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260807 13:39:24.111140 21996 tablet_service.cc:1467] Processing CreateTablet for tablet 84a2737494bb45768d81f593432c7145 (DEFAULT_TABLE table=test-workload [id=8b9f86e3378d462b95ba50454059b25a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260807 13:39:24.111644 21995 tablet_service.cc:1467] Processing CreateTablet for tablet 7e98d476a5144fa9bf7470cd679bd4bd (DEFAULT_TABLE table=test-workload [id=8b9f86e3378d462b95ba50454059b25a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260807 13:39:24.099157 21997 tablet_service.cc:1467] Processing CreateTablet for tablet b930bdfd826e4d96b62ab161cae7bd44 (DEFAULT_TABLE table=test-workload [id=8b9f86e3378d462b95ba50454059b25a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260807 13:39:24.118778 21999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efede11e063a479a9064465add093ed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:24.117913 21993 tablet_service.cc:1467] Processing CreateTablet for tablet 6f765d57daa445ac921adbf4e9cbda89 (DEFAULT_TABLE table=test-workload [id=8b9f86e3378d462b95ba50454059b25a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260807 13:39:24.122140 21994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e18532a632434a23ba646b0c9af99180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:24.124097 21991 tablet_service.cc:1467] Processing CreateTablet for tablet 192a1c6675714a2f84c6512dcbafdf7f (DEFAULT_TABLE table=test-workload [id=8b9f86e3378d462b95ba50454059b25a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260807 13:39:24.120285 21992 tablet_service.cc:1467] Processing CreateTablet for tablet 587be77f04c94532a0c5cff6fc7c638f (DEFAULT_TABLE table=test-workload [id=8b9f86e3378d462b95ba50454059b25a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260807 13:39:24.129325 21996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84a2737494bb45768d81f593432c7145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:24.130769 21995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e98d476a5144fa9bf7470cd679bd4bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:24.132509 21997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b930bdfd826e4d96b62ab161cae7bd44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:24.133641 21992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 587be77f04c94532a0c5cff6fc7c638f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:24.135619 21998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e173a6d914a64a95badab506789de0fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:24.167984 21991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 192a1c6675714a2f84c6512dcbafdf7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:24.192457 21993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f765d57daa445ac921adbf4e9cbda89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:24.187633 22106 tablet_service.cc:1467] Processing CreateTablet for tablet efede11e063a479a9064465add093ed7 (DEFAULT_TABLE table=test-workload [id=8b9f86e3378d462b95ba50454059b25a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260807 13:39:24.200906 22103 tablet_service.cc:1467] Processing CreateTablet for tablet b930bdfd826e4d96b62ab161cae7bd44 (DEFAULT_TABLE table=test-workload [id=8b9f86e3378d462b95ba50454059b25a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260807 13:39:24.206766 22100 tablet_service.cc:1467] Processing CreateTablet for tablet 7e98d476a5144fa9bf7470cd679bd4bd (DEFAULT_TABLE table=test-workload [id=8b9f86e3378d462b95ba50454059b25a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260807 13:39:24.227602 22103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b930bdfd826e4d96b62ab161cae7bd44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:24.206444 22105 tablet_service.cc:1467] Processing CreateTablet for tablet e173a6d914a64a95badab506789de0fe (DEFAULT_TABLE table=test-workload [id=8b9f86e3378d462b95ba50454059b25a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260807 13:39:24.204336 22101 tablet_service.cc:1467] Processing CreateTablet for tablet 84a2737494bb45768d81f593432c7145 (DEFAULT_TABLE table=test-workload [id=8b9f86e3378d462b95ba50454059b25a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260807 13:39:24.235903 22213 tablet_service.cc:1467] Processing CreateTablet for tablet e173a6d914a64a95badab506789de0fe (DEFAULT_TABLE table=test-workload [id=8b9f86e3378d462b95ba50454059b25a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260807 13:39:24.231164 22099 tablet_service.cc:1467] Processing CreateTablet for tablet e18532a632434a23ba646b0c9af99180 (DEFAULT_TABLE table=test-workload [id=8b9f86e3378d462b95ba50454059b25a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260807 13:39:24.243299 22106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efede11e063a479a9064465add093ed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:24.233054 22098 tablet_service.cc:1467] Processing CreateTablet for tablet 6f765d57daa445ac921adbf4e9cbda89 (DEFAULT_TABLE table=test-workload [id=8b9f86e3378d462b95ba50454059b25a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260807 13:39:24.245184 22097 tablet_service.cc:1467] Processing CreateTablet for tablet 587be77f04c94532a0c5cff6fc7c638f (DEFAULT_TABLE table=test-workload [id=8b9f86e3378d462b95ba50454059b25a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
W20260807 13:39:24.253978 21939 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:39:24.258051 22105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e173a6d914a64a95badab506789de0fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:24.262154 22097 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 587be77f04c94532a0c5cff6fc7c638f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:24.258400 22213 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e173a6d914a64a95badab506789de0fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:24.257850 22211 tablet_service.cc:1467] Processing CreateTablet for tablet b930bdfd826e4d96b62ab161cae7bd44 (DEFAULT_TABLE table=test-workload [id=8b9f86e3378d462b95ba50454059b25a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260807 13:39:24.245517 22214 tablet_service.cc:1467] Processing CreateTablet for tablet efede11e063a479a9064465add093ed7 (DEFAULT_TABLE table=test-workload [id=8b9f86e3378d462b95ba50454059b25a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260807 13:39:24.280840 22101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84a2737494bb45768d81f593432c7145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:24.267637 22096 tablet_service.cc:1467] Processing CreateTablet for tablet 192a1c6675714a2f84c6512dcbafdf7f (DEFAULT_TABLE table=test-workload [id=8b9f86e3378d462b95ba50454059b25a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260807 13:39:24.283885 22208 tablet_service.cc:1467] Processing CreateTablet for tablet 84a2737494bb45768d81f593432c7145 (DEFAULT_TABLE table=test-workload [id=8b9f86e3378d462b95ba50454059b25a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260807 13:39:24.290995 22214 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efede11e063a479a9064465add093ed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:24.303275 22205 tablet_service.cc:1467] Processing CreateTablet for tablet e18532a632434a23ba646b0c9af99180 (DEFAULT_TABLE table=test-workload [id=8b9f86e3378d462b95ba50454059b25a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260807 13:39:24.301291 22207 tablet_service.cc:1467] Processing CreateTablet for tablet 7e98d476a5144fa9bf7470cd679bd4bd (DEFAULT_TABLE table=test-workload [id=8b9f86e3378d462b95ba50454059b25a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260807 13:39:24.304039 22098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f765d57daa445ac921adbf4e9cbda89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:24.309957 22208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84a2737494bb45768d81f593432c7145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:24.309631 22204 tablet_service.cc:1467] Processing CreateTablet for tablet 6f765d57daa445ac921adbf4e9cbda89 (DEFAULT_TABLE table=test-workload [id=8b9f86e3378d462b95ba50454059b25a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260807 13:39:24.325314 22201 tablet_service.cc:1467] Processing CreateTablet for tablet 192a1c6675714a2f84c6512dcbafdf7f (DEFAULT_TABLE table=test-workload [id=8b9f86e3378d462b95ba50454059b25a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260807 13:39:24.331974 22153 heartbeater.cc:503] Master 127.21.82.126:36399 was elected leader, sending a full tablet report...
I20260807 13:39:24.332823 22100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e98d476a5144fa9bf7470cd679bd4bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:24.330520 22203 tablet_service.cc:1467] Processing CreateTablet for tablet 587be77f04c94532a0c5cff6fc7c638f (DEFAULT_TABLE table=test-workload [id=8b9f86e3378d462b95ba50454059b25a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260807 13:39:24.331969 22207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e98d476a5144fa9bf7470cd679bd4bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:24.339079 22201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 192a1c6675714a2f84c6512dcbafdf7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:24.343180 22203 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 587be77f04c94532a0c5cff6fc7c638f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:24.348387 22205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e18532a632434a23ba646b0c9af99180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:24.352242 22204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f765d57daa445ac921adbf4e9cbda89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:24.358819 22211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b930bdfd826e4d96b62ab161cae7bd44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:24.361223 22096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 192a1c6675714a2f84c6512dcbafdf7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:24.376992 22099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e18532a632434a23ba646b0c9af99180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:24.390271 22283 tablet_bootstrap.cc:492] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3: Bootstrap starting.
I20260807 13:39:24.637816 22285 tablet_bootstrap.cc:492] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf: Bootstrap starting.
I20260807 13:39:24.644948 22284 tablet_bootstrap.cc:492] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86: Bootstrap starting.
I20260807 13:39:24.669023 22283 tablet_bootstrap.cc:654] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:24.698566 22285 tablet_bootstrap.cc:654] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:24.701771 22284 tablet_bootstrap.cc:654] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:24.710341 22283 tablet_bootstrap.cc:492] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3: No bootstrap required, opened a new log
I20260807 13:39:24.711262 22283 ts_tablet_manager.cc:1397] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3: Time spent bootstrapping tablet: real 0.324s user 0.029s sys 0.006s
I20260807 13:39:24.718143 22283 raft_consensus.cc:348] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:24.719678 22283 raft_consensus.cc:374] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:24.720130 22284 tablet_bootstrap.cc:492] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86: No bootstrap required, opened a new log
I20260807 13:39:24.720360 22283 raft_consensus.cc:729] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 063fa962cd1747b59eaba0dfdf2dc8c3, State: Initialized, Role: FOLLOWER
I20260807 13:39:24.720847 22284 ts_tablet_manager.cc:1397] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86: Time spent bootstrapping tablet: real 0.079s user 0.007s sys 0.025s
I20260807 13:39:24.721978 22283 consensus_queue.cc:260] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:24.731662 22284 raft_consensus.cc:348] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:24.733170 22284 raft_consensus.cc:374] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:24.733728 22284 raft_consensus.cc:729] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fa58ef028644655948f04747f2bde86, State: Initialized, Role: FOLLOWER
I20260807 13:39:24.735252 22284 consensus_queue.cc:260] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:24.741483 22258 heartbeater.cc:503] Master 127.21.82.126:36399 was elected leader, sending a full tablet report...
I20260807 13:39:24.743754 22285 tablet_bootstrap.cc:492] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf: No bootstrap required, opened a new log
I20260807 13:39:24.744513 22285 ts_tablet_manager.cc:1397] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf: Time spent bootstrapping tablet: real 0.126s user 0.017s sys 0.028s
I20260807 13:39:24.754272 22285 raft_consensus.cc:348] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:24.755544 22285 raft_consensus.cc:374] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:24.756328 22285 raft_consensus.cc:729] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bfc0ccff3be472ba85e284cb351d1bf, State: Initialized, Role: FOLLOWER
I20260807 13:39:24.768078 22285 consensus_queue.cc:260] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:24.766501 22284 ts_tablet_manager.cc:1428] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86: Time spent starting tablet: real 0.045s user 0.010s sys 0.026s
I20260807 13:39:24.772836 22284 tablet_bootstrap.cc:492] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86: Bootstrap starting.
W20260807 13:39:24.776677 22156 tablet.cc:2369] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 13:39:24.783517 22283 ts_tablet_manager.cc:1428] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3: Time spent starting tablet: real 0.072s user 0.011s sys 0.039s
I20260807 13:39:24.785097 22283 tablet_bootstrap.cc:492] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3: Bootstrap starting.
I20260807 13:39:24.799008 22295 raft_consensus.cc:482] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:24.800159 22295 raft_consensus.cc:504] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:24.800912 22285 ts_tablet_manager.cc:1428] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf: Time spent starting tablet: real 0.056s user 0.018s sys 0.016s
I20260807 13:39:24.804975 22285 tablet_bootstrap.cc:492] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf: Bootstrap starting.
I20260807 13:39:24.805924 22295 leader_election.cc:288] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193)
I20260807 13:39:24.870991 22285 tablet_bootstrap.cc:654] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:24.873060 22283 tablet_bootstrap.cc:654] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:24.882808 22284 tablet_bootstrap.cc:654] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:24.909124 22016 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "192a1c6675714a2f84c6512dcbafdf7f" candidate_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" is_pre_election: true
I20260807 13:39:24.912238 22283 tablet_bootstrap.cc:492] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3: No bootstrap required, opened a new log
I20260807 13:39:24.915388 22283 ts_tablet_manager.cc:1397] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3: Time spent bootstrapping tablet: real 0.131s user 0.015s sys 0.018s
W20260807 13:39:24.915716 22180 leader_election.cc:341] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:24.923736 22120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "192a1c6675714a2f84c6512dcbafdf7f" candidate_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fa58ef028644655948f04747f2bde86" is_pre_election: true
W20260807 13:39:24.928478 22177 leader_election.cc:341] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:24.929518 22177 leader_election.cc:302] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bfc0ccff3be472ba85e284cb351d1bf; no voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 7fa58ef028644655948f04747f2bde86
I20260807 13:39:24.935310 22297 raft_consensus.cc:2726] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:39:24.938881 22283 raft_consensus.cc:348] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:24.940274 22283 raft_consensus.cc:374] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:24.940856 22283 raft_consensus.cc:729] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 063fa962cd1747b59eaba0dfdf2dc8c3, State: Initialized, Role: FOLLOWER
I20260807 13:39:24.942175 22283 consensus_queue.cc:260] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:24.943490 22285 tablet_bootstrap.cc:492] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf: No bootstrap required, opened a new log
I20260807 13:39:24.944321 22285 ts_tablet_manager.cc:1397] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf: Time spent bootstrapping tablet: real 0.142s user 0.006s sys 0.031s
I20260807 13:39:24.943310 22284 tablet_bootstrap.cc:492] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86: No bootstrap required, opened a new log
I20260807 13:39:24.951164 22284 ts_tablet_manager.cc:1397] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86: Time spent bootstrapping tablet: real 0.179s user 0.004s sys 0.033s
I20260807 13:39:24.950610 22283 ts_tablet_manager.cc:1428] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3: Time spent starting tablet: real 0.035s user 0.000s sys 0.013s
I20260807 13:39:24.952997 22283 tablet_bootstrap.cc:492] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3: Bootstrap starting.
I20260807 13:39:24.956964 22284 raft_consensus.cc:348] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:24.958011 22284 raft_consensus.cc:374] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:24.958415 22284 raft_consensus.cc:729] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fa58ef028644655948f04747f2bde86, State: Initialized, Role: FOLLOWER
I20260807 13:39:24.959604 22284 consensus_queue.cc:260] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:24.965613 22284 ts_tablet_manager.cc:1428] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86: Time spent starting tablet: real 0.014s user 0.004s sys 0.006s
I20260807 13:39:24.962005 22285 raft_consensus.cc:348] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:24.966643 22284 tablet_bootstrap.cc:492] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86: Bootstrap starting.
I20260807 13:39:24.967087 22285 raft_consensus.cc:374] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:24.967773 22285 raft_consensus.cc:729] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bfc0ccff3be472ba85e284cb351d1bf, State: Initialized, Role: FOLLOWER
I20260807 13:39:24.969082 22285 consensus_queue.cc:260] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:24.984856 22285 ts_tablet_manager.cc:1428] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf: Time spent starting tablet: real 0.040s user 0.012s sys 0.001s
I20260807 13:39:24.985947 22283 tablet_bootstrap.cc:654] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:24.986637 22285 tablet_bootstrap.cc:492] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf: Bootstrap starting.
I20260807 13:39:24.992682 22284 tablet_bootstrap.cc:654] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:24.998910 22294 raft_consensus.cc:482] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:25.000187 22294 raft_consensus.cc:504] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.013200 22294 leader_election.cc:288] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:25.040608 22285 tablet_bootstrap.cc:654] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:25.068858 22292 raft_consensus.cc:482] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:25.070271 22292 raft_consensus.cc:504] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.079764 22292 leader_election.cc:288] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:25.089562 22294 raft_consensus.cc:482] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:25.085847 22284 tablet_bootstrap.cc:492] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86: No bootstrap required, opened a new log
I20260807 13:39:25.091933 22284 ts_tablet_manager.cc:1397] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86: Time spent bootstrapping tablet: real 0.125s user 0.017s sys 0.019s
I20260807 13:39:25.090497 22294 raft_consensus.cc:504] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.100404 22294 leader_election.cc:288] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:25.101583 22283 tablet_bootstrap.cc:492] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3: No bootstrap required, opened a new log
I20260807 13:39:25.102849 22283 ts_tablet_manager.cc:1397] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3: Time spent bootstrapping tablet: real 0.150s user 0.014s sys 0.028s
I20260807 13:39:25.111487 22283 raft_consensus.cc:348] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.112483 22283 raft_consensus.cc:374] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:25.112861 22283 raft_consensus.cc:729] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 063fa962cd1747b59eaba0dfdf2dc8c3, State: Initialized, Role: FOLLOWER
I20260807 13:39:25.113634 22283 consensus_queue.cc:260] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.104326 22284 raft_consensus.cc:348] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.126013 22292 raft_consensus.cc:482] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:25.126973 22292 raft_consensus.cc:504] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.126248 22283 ts_tablet_manager.cc:1428] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3: Time spent starting tablet: real 0.022s user 0.003s sys 0.007s
I20260807 13:39:25.120754 22284 raft_consensus.cc:374] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:25.128326 22016 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efede11e063a479a9064465add093ed7" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" is_pre_election: true
I20260807 13:39:25.131896 22014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b930bdfd826e4d96b62ab161cae7bd44" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" is_pre_election: true
I20260807 13:39:25.133248 22284 raft_consensus.cc:729] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fa58ef028644655948f04747f2bde86, State: Initialized, Role: FOLLOWER
W20260807 13:39:25.136381 22075 leader_election.cc:341] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:25.136806 22283 tablet_bootstrap.cc:492] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3: Bootstrap starting.
W20260807 13:39:25.137619 22075 leader_election.cc:341] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:25.143373 22284 consensus_queue.cc:260] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.150981 22292 leader_election.cc:288] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:25.146152 22285 tablet_bootstrap.cc:492] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf: No bootstrap required, opened a new log
I20260807 13:39:25.158394 22285 ts_tablet_manager.cc:1397] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf: Time spent bootstrapping tablet: real 0.172s user 0.006s sys 0.034s
I20260807 13:39:25.167229 22226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b930bdfd826e4d96b62ab161cae7bd44" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" is_pre_election: true
I20260807 13:39:25.163450 22227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efede11e063a479a9064465add093ed7" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" is_pre_election: true
W20260807 13:39:25.174203 22072 leader_election.cc:341] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:25.174914 22072 leader_election.cc:302] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7fa58ef028644655948f04747f2bde86; no voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 3bfc0ccff3be472ba85e284cb351d1bf
I20260807 13:39:25.171015 22284 ts_tablet_manager.cc:1428] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86: Time spent starting tablet: real 0.078s user 0.013s sys 0.002s
I20260807 13:39:25.176409 22294 raft_consensus.cc:2726] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:39:25.188380 22283 tablet_bootstrap.cc:654] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:25.190126 22284 tablet_bootstrap.cc:492] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86: Bootstrap starting.
I20260807 13:39:25.193399 22285 raft_consensus.cc:348] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.194552 22285 raft_consensus.cc:374] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:25.195091 22285 raft_consensus.cc:729] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bfc0ccff3be472ba85e284cb351d1bf, State: Initialized, Role: FOLLOWER
I20260807 13:39:25.196091 22285 consensus_queue.cc:260] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.198097 22227 raft_consensus.cc:2454] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fa58ef028644655948f04747f2bde86 in term 0.
I20260807 13:39:25.204370 22072 leader_election.cc:302] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bfc0ccff3be472ba85e284cb351d1bf, 7fa58ef028644655948f04747f2bde86; no voters: 063fa962cd1747b59eaba0dfdf2dc8c3
I20260807 13:39:25.206238 22294 raft_consensus.cc:2781] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:39:25.207193 22294 raft_consensus.cc:482] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:25.207754 22294 raft_consensus.cc:3037] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:25.209594 22285 ts_tablet_manager.cc:1428] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf: Time spent starting tablet: real 0.050s user 0.008s sys 0.004s
I20260807 13:39:25.215663 22285 tablet_bootstrap.cc:492] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf: Bootstrap starting.
I20260807 13:39:25.247262 22283 tablet_bootstrap.cc:492] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3: No bootstrap required, opened a new log
I20260807 13:39:25.246491 22294 raft_consensus.cc:504] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.248080 22283 ts_tablet_manager.cc:1397] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3: Time spent bootstrapping tablet: real 0.112s user 0.014s sys 0.016s
I20260807 13:39:25.251845 22294 leader_election.cc:288] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 election: Requested vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:25.252902 22014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efede11e063a479a9064465add093ed7" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
I20260807 13:39:25.253300 22227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efede11e063a479a9064465add093ed7" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
I20260807 13:39:25.253271 22283 raft_consensus.cc:348] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.254230 22227 raft_consensus.cc:3037] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:25.254339 22283 raft_consensus.cc:374] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:25.254901 22283 raft_consensus.cc:729] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 063fa962cd1747b59eaba0dfdf2dc8c3, State: Initialized, Role: FOLLOWER
W20260807 13:39:25.254976 22075 leader_election.cc:341] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:25.259037 22284 tablet_bootstrap.cc:654] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:25.261224 22283 consensus_queue.cc:260] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.264338 22285 tablet_bootstrap.cc:654] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:25.267068 22119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e173a6d914a64a95badab506789de0fe" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fa58ef028644655948f04747f2bde86" is_pre_election: true
I20260807 13:39:25.271950 22283 ts_tablet_manager.cc:1428] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3: Time spent starting tablet: real 0.023s user 0.004s sys 0.007s
I20260807 13:39:25.269855 22120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e98d476a5144fa9bf7470cd679bd4bd" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fa58ef028644655948f04747f2bde86" is_pre_election: true
I20260807 13:39:25.277029 22226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e98d476a5144fa9bf7470cd679bd4bd" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" is_pre_election: true
W20260807 13:39:25.274255 21939 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260807 13:39:25.280481 21972 leader_election.cc:341] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:25.280535 22225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e173a6d914a64a95badab506789de0fe" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" is_pre_election: true
W20260807 13:39:25.283970 21972 leader_election.cc:341] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:25.284926 22283 tablet_bootstrap.cc:492] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3: Bootstrap starting.
I20260807 13:39:25.285405 21972 leader_election.cc:302] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 063fa962cd1747b59eaba0dfdf2dc8c3; no voters: 3bfc0ccff3be472ba85e284cb351d1bf, 7fa58ef028644655948f04747f2bde86
I20260807 13:39:25.290536 22292 raft_consensus.cc:2726] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 13:39:25.292786 21972 leader_election.cc:341] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:39:25.294677 21972 leader_election.cc:341] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:25.295267 21972 leader_election.cc:302] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 063fa962cd1747b59eaba0dfdf2dc8c3; no voters: 3bfc0ccff3be472ba85e284cb351d1bf, 7fa58ef028644655948f04747f2bde86
I20260807 13:39:25.298727 22285 tablet_bootstrap.cc:492] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf: No bootstrap required, opened a new log
I20260807 13:39:25.299482 22285 ts_tablet_manager.cc:1397] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf: Time spent bootstrapping tablet: real 0.086s user 0.013s sys 0.016s
I20260807 13:39:25.300443 22292 raft_consensus.cc:2726] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:39:25.302297 22227 raft_consensus.cc:2454] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fa58ef028644655948f04747f2bde86 in term 1.
I20260807 13:39:25.304188 22072 leader_election.cc:302] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bfc0ccff3be472ba85e284cb351d1bf, 7fa58ef028644655948f04747f2bde86; no voters: 063fa962cd1747b59eaba0dfdf2dc8c3
I20260807 13:39:25.306231 22294 raft_consensus.cc:2781] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:39:25.318984 22283 tablet_bootstrap.cc:654] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:25.320060 22284 tablet_bootstrap.cc:492] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86: No bootstrap required, opened a new log
I20260807 13:39:25.321096 22284 ts_tablet_manager.cc:1397] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86: Time spent bootstrapping tablet: real 0.131s user 0.011s sys 0.024s
I20260807 13:39:25.321697 22294 raft_consensus.cc:686] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [term 1 LEADER]: Becoming Leader. State: Replica: 7fa58ef028644655948f04747f2bde86, State: Running, Role: LEADER
I20260807 13:39:25.323289 22294 consensus_queue.cc:237] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.324990 22285 raft_consensus.cc:348] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.326197 22285 raft_consensus.cc:374] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:25.326980 22285 raft_consensus.cc:729] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bfc0ccff3be472ba85e284cb351d1bf, State: Initialized, Role: FOLLOWER
I20260807 13:39:25.327679 22284 raft_consensus.cc:348] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.328846 22284 raft_consensus.cc:374] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:25.329371 22284 raft_consensus.cc:729] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fa58ef028644655948f04747f2bde86, State: Initialized, Role: FOLLOWER
I20260807 13:39:25.328608 22285 consensus_queue.cc:260] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.330579 22284 consensus_queue.cc:260] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.334072 22285 ts_tablet_manager.cc:1428] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf: Time spent starting tablet: real 0.034s user 0.003s sys 0.010s
I20260807 13:39:25.335232 22284 ts_tablet_manager.cc:1428] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86: Time spent starting tablet: real 0.013s user 0.006s sys 0.005s
I20260807 13:39:25.335678 22285 tablet_bootstrap.cc:492] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf: Bootstrap starting.
I20260807 13:39:25.336795 22284 tablet_bootstrap.cc:492] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86: Bootstrap starting.
I20260807 13:39:25.348037 22292 raft_consensus.cc:482] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:25.348953 22292 raft_consensus.cc:504] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.355134 22292 leader_election.cc:288] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:25.356546 22119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "587be77f04c94532a0c5cff6fc7c638f" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fa58ef028644655948f04747f2bde86" is_pre_election: true
I20260807 13:39:25.357374 22119 raft_consensus.cc:2454] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 063fa962cd1747b59eaba0dfdf2dc8c3 in term 0.
I20260807 13:39:25.359388 22227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "587be77f04c94532a0c5cff6fc7c638f" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" is_pre_election: true
I20260807 13:39:25.360697 21972 leader_election.cc:302] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 7fa58ef028644655948f04747f2bde86; no voters:
W20260807 13:39:25.362540 21972 leader_election.cc:341] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:25.365976 22283 tablet_bootstrap.cc:492] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3: No bootstrap required, opened a new log
I20260807 13:39:25.366415 22283 ts_tablet_manager.cc:1397] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3: Time spent bootstrapping tablet: real 0.083s user 0.009s sys 0.026s
I20260807 13:39:25.363426 22292 raft_consensus.cc:2781] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:39:25.367448 22292 raft_consensus.cc:482] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:25.367887 22292 raft_consensus.cc:3037] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:25.371160 21874 catalog_manager.cc:5495] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fa58ef028644655948f04747f2bde86 (127.21.82.66). New cstate: current_term: 1 leader_uuid: "7fa58ef028644655948f04747f2bde86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:25.381007 22283 raft_consensus.cc:348] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.381699 22283 raft_consensus.cc:374] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:25.383296 22283 raft_consensus.cc:729] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 063fa962cd1747b59eaba0dfdf2dc8c3, State: Initialized, Role: FOLLOWER
I20260807 13:39:25.388598 22292 raft_consensus.cc:504] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.389611 22283 consensus_queue.cc:260] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.387599 22285 tablet_bootstrap.cc:654] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:25.388696 22284 tablet_bootstrap.cc:654] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:25.393949 22119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "587be77f04c94532a0c5cff6fc7c638f" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fa58ef028644655948f04747f2bde86"
I20260807 13:39:25.394696 22119 raft_consensus.cc:3037] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:25.401861 22297 raft_consensus.cc:482] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:25.407756 22227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "587be77f04c94532a0c5cff6fc7c638f" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
W20260807 13:39:25.409694 21972 leader_election.cc:341] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:25.404891 22297 raft_consensus.cc:504] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.413429 22297 leader_election.cc:288] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193)
I20260807 13:39:25.414068 22014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84a2737494bb45768d81f593432c7145" candidate_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" is_pre_election: true
I20260807 13:39:25.415283 22120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84a2737494bb45768d81f593432c7145" candidate_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fa58ef028644655948f04747f2bde86" is_pre_election: true
I20260807 13:39:25.415882 22014 raft_consensus.cc:2454] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bfc0ccff3be472ba85e284cb351d1bf in term 0.
W20260807 13:39:25.416707 22177 leader_election.cc:341] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:25.417447 22180 leader_election.cc:302] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 3bfc0ccff3be472ba85e284cb351d1bf; no voters: 7fa58ef028644655948f04747f2bde86
I20260807 13:39:25.418954 22297 raft_consensus.cc:2781] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:39:25.419421 22297 raft_consensus.cc:482] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:25.419823 22297 raft_consensus.cc:3037] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:25.423031 22119 raft_consensus.cc:2454] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 063fa962cd1747b59eaba0dfdf2dc8c3 in term 1.
I20260807 13:39:25.424563 21972 leader_election.cc:302] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 7fa58ef028644655948f04747f2bde86; no voters: 3bfc0ccff3be472ba85e284cb351d1bf
I20260807 13:39:25.432873 22297 raft_consensus.cc:504] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.402758 22292 leader_election.cc:288] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 1 election: Requested vote from peers 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:25.436838 22297 leader_election.cc:288] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 1 election: Requested vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193)
I20260807 13:39:25.437453 22014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84a2737494bb45768d81f593432c7145" candidate_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
I20260807 13:39:25.439291 22014 raft_consensus.cc:3037] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:25.440088 22292 raft_consensus.cc:2781] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:39:25.438160 22120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84a2737494bb45768d81f593432c7145" candidate_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fa58ef028644655948f04747f2bde86"
I20260807 13:39:25.440855 22292 raft_consensus.cc:686] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 LEADER]: Becoming Leader. State: Replica: 063fa962cd1747b59eaba0dfdf2dc8c3, State: Running, Role: LEADER
I20260807 13:39:25.449026 22292 consensus_queue.cc:237] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
W20260807 13:39:25.458855 22177 leader_election.cc:341] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:25.462527 22284 tablet_bootstrap.cc:492] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86: No bootstrap required, opened a new log
I20260807 13:39:25.463207 22284 ts_tablet_manager.cc:1397] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86: Time spent bootstrapping tablet: real 0.127s user 0.009s sys 0.016s
I20260807 13:39:25.467258 22284 raft_consensus.cc:348] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.468546 22283 ts_tablet_manager.cc:1428] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3: Time spent starting tablet: real 0.102s user 0.011s sys 0.029s
I20260807 13:39:25.468545 22284 raft_consensus.cc:374] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:25.466509 22014 raft_consensus.cc:2454] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bfc0ccff3be472ba85e284cb351d1bf in term 1.
I20260807 13:39:25.470201 22284 raft_consensus.cc:729] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fa58ef028644655948f04747f2bde86, State: Initialized, Role: FOLLOWER
I20260807 13:39:25.479355 22180 leader_election.cc:302] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 3bfc0ccff3be472ba85e284cb351d1bf; no voters: 7fa58ef028644655948f04747f2bde86
I20260807 13:39:25.480754 22297 raft_consensus.cc:2781] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:39:25.481354 22283 tablet_bootstrap.cc:492] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3: Bootstrap starting.
I20260807 13:39:25.481491 22285 tablet_bootstrap.cc:492] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf: No bootstrap required, opened a new log
I20260807 13:39:25.482112 22285 ts_tablet_manager.cc:1397] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf: Time spent bootstrapping tablet: real 0.147s user 0.024s sys 0.027s
I20260807 13:39:25.490105 22284 consensus_queue.cc:260] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.499423 22284 ts_tablet_manager.cc:1428] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86: Time spent starting tablet: real 0.036s user 0.006s sys 0.004s
I20260807 13:39:25.499886 22283 tablet_bootstrap.cc:654] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:25.500545 22284 tablet_bootstrap.cc:492] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86: Bootstrap starting.
I20260807 13:39:25.503279 22297 raft_consensus.cc:686] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 LEADER]: Becoming Leader. State: Replica: 3bfc0ccff3be472ba85e284cb351d1bf, State: Running, Role: LEADER
I20260807 13:39:25.496445 22285 raft_consensus.cc:348] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.505093 22285 raft_consensus.cc:374] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:25.505565 22285 raft_consensus.cc:729] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bfc0ccff3be472ba85e284cb351d1bf, State: Initialized, Role: FOLLOWER
I20260807 13:39:25.513002 22343 raft_consensus.cc:482] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:25.515791 22343 raft_consensus.cc:504] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.510613 22297 consensus_queue.cc:237] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.513285 22285 consensus_queue.cc:260] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.519604 22294 raft_consensus.cc:482] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:25.518446 21875 catalog_manager.cc:5495] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65). New cstate: current_term: 1 leader_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:25.520221 22294 raft_consensus.cc:504] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.522460 22294 leader_election.cc:288] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:25.524627 22227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e18532a632434a23ba646b0c9af99180" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" is_pre_election: true
I20260807 13:39:25.524784 22014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e18532a632434a23ba646b0c9af99180" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" is_pre_election: true
I20260807 13:39:25.527384 22227 raft_consensus.cc:2454] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fa58ef028644655948f04747f2bde86 in term 0.
W20260807 13:39:25.528492 22075 leader_election.cc:341] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:25.529336 22072 leader_election.cc:302] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bfc0ccff3be472ba85e284cb351d1bf, 7fa58ef028644655948f04747f2bde86; no voters: 063fa962cd1747b59eaba0dfdf2dc8c3
I20260807 13:39:25.529256 22343 leader_election.cc:288] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193)
I20260807 13:39:25.530508 22014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b930bdfd826e4d96b62ab161cae7bd44" candidate_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" is_pre_election: true
I20260807 13:39:25.531286 22014 raft_consensus.cc:2454] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bfc0ccff3be472ba85e284cb351d1bf in term 0.
I20260807 13:39:25.531509 22120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b930bdfd826e4d96b62ab161cae7bd44" candidate_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fa58ef028644655948f04747f2bde86" is_pre_election: true
I20260807 13:39:25.532289 22120 raft_consensus.cc:2454] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bfc0ccff3be472ba85e284cb351d1bf in term 0.
I20260807 13:39:25.532523 22180 leader_election.cc:302] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 3bfc0ccff3be472ba85e284cb351d1bf; no voters:
I20260807 13:39:25.538756 22294 raft_consensus.cc:2781] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:39:25.539248 22294 raft_consensus.cc:482] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:25.539994 22294 raft_consensus.cc:3037] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:25.539181 22284 tablet_bootstrap.cc:654] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:25.547844 22343 raft_consensus.cc:2781] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:39:25.553795 22343 raft_consensus.cc:482] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:25.557399 22343 raft_consensus.cc:3037] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:25.581312 22285 ts_tablet_manager.cc:1428] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf: Time spent starting tablet: real 0.099s user 0.013s sys 0.007s
I20260807 13:39:25.574951 22294 raft_consensus.cc:504] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.587754 22294 leader_election.cc:288] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 election: Requested vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:25.594827 22014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e18532a632434a23ba646b0c9af99180" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
I20260807 13:39:25.599282 22227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e18532a632434a23ba646b0c9af99180" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
I20260807 13:39:25.600553 22227 raft_consensus.cc:3037] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:39:25.608214 22075 leader_election.cc:341] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:25.623734 22227 raft_consensus.cc:2454] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fa58ef028644655948f04747f2bde86 in term 1.
I20260807 13:39:25.626446 22285 tablet_bootstrap.cc:492] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf: Bootstrap starting.
I20260807 13:39:25.631573 22283 tablet_bootstrap.cc:492] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3: No bootstrap required, opened a new log
I20260807 13:39:25.632612 22283 ts_tablet_manager.cc:1397] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3: Time spent bootstrapping tablet: real 0.152s user 0.018s sys 0.016s
I20260807 13:39:25.632664 22072 leader_election.cc:302] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bfc0ccff3be472ba85e284cb351d1bf, 7fa58ef028644655948f04747f2bde86; no voters: 063fa962cd1747b59eaba0dfdf2dc8c3
I20260807 13:39:25.634554 22294 raft_consensus.cc:2781] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:39:25.634503 22343 raft_consensus.cc:504] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.635272 22294 raft_consensus.cc:686] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 1 LEADER]: Becoming Leader. State: Replica: 7fa58ef028644655948f04747f2bde86, State: Running, Role: LEADER
I20260807 13:39:25.638932 22014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b930bdfd826e4d96b62ab161cae7bd44" candidate_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
I20260807 13:39:25.639484 22284 tablet_bootstrap.cc:492] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86: No bootstrap required, opened a new log
I20260807 13:39:25.639969 22284 ts_tablet_manager.cc:1397] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86: Time spent bootstrapping tablet: real 0.140s user 0.021s sys 0.046s
I20260807 13:39:25.639847 22014 raft_consensus.cc:3037] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:25.636701 22294 consensus_queue.cc:237] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.643760 22284 raft_consensus.cc:348] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.644912 22284 raft_consensus.cc:374] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:25.645347 22284 raft_consensus.cc:729] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fa58ef028644655948f04747f2bde86, State: Initialized, Role: FOLLOWER
I20260807 13:39:25.645239 22283 raft_consensus.cc:348] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.646461 22283 raft_consensus.cc:374] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:25.646438 22284 consensus_queue.cc:260] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.647095 22283 raft_consensus.cc:729] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 063fa962cd1747b59eaba0dfdf2dc8c3, State: Initialized, Role: FOLLOWER
I20260807 13:39:25.647054 21874 catalog_manager.cc:5495] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67). New cstate: current_term: 1 leader_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } health_report { overall_health: HEALTHY } } }
I20260807 13:39:25.648289 22283 consensus_queue.cc:260] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.649327 22284 ts_tablet_manager.cc:1428] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86: Time spent starting tablet: real 0.009s user 0.005s sys 0.002s
I20260807 13:39:25.650416 22284 tablet_bootstrap.cc:492] T 192a1c6675714a2f84c6512dcbafdf7f P 7fa58ef028644655948f04747f2bde86: Bootstrap starting.
I20260807 13:39:25.661101 22343 leader_election.cc:288] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 1 election: Requested vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193)
I20260807 13:39:25.665409 22120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b930bdfd826e4d96b62ab161cae7bd44" candidate_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fa58ef028644655948f04747f2bde86"
I20260807 13:39:25.666644 22120 raft_consensus.cc:3037] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:25.660065 22283 ts_tablet_manager.cc:1428] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3: Time spent starting tablet: real 0.027s user 0.004s sys 0.007s
I20260807 13:39:25.668982 22014 raft_consensus.cc:2454] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bfc0ccff3be472ba85e284cb351d1bf in term 1.
I20260807 13:39:25.674165 22284 tablet_bootstrap.cc:654] T 192a1c6675714a2f84c6512dcbafdf7f P 7fa58ef028644655948f04747f2bde86: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:25.680342 22180 leader_election.cc:302] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 3bfc0ccff3be472ba85e284cb351d1bf; no voters:
I20260807 13:39:25.674530 22292 raft_consensus.cc:482] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:25.683429 22292 raft_consensus.cc:504] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.678553 22283 tablet_bootstrap.cc:492] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3: Bootstrap starting.
I20260807 13:39:25.690169 22324 raft_consensus.cc:482] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:25.691952 22285 tablet_bootstrap.cc:654] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:25.691771 22119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "192a1c6675714a2f84c6512dcbafdf7f" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fa58ef028644655948f04747f2bde86" is_pre_election: true
I20260807 13:39:25.691373 22324 raft_consensus.cc:504] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.687614 22343 raft_consensus.cc:2781] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:39:25.699640 22014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84a2737494bb45768d81f593432c7145" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" is_pre_election: true
I20260807 13:39:25.700102 22343 raft_consensus.cc:686] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 LEADER]: Becoming Leader. State: Replica: 3bfc0ccff3be472ba85e284cb351d1bf, State: Running, Role: LEADER
W20260807 13:39:25.695076 21972 leader_election.cc:341] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:25.702241 22014 raft_consensus.cc:2379] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7fa58ef028644655948f04747f2bde86 in current term 1: Already voted for candidate 3bfc0ccff3be472ba85e284cb351d1bf in this term.
I20260807 13:39:25.703961 22225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "192a1c6675714a2f84c6512dcbafdf7f" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" is_pre_election: true
I20260807 13:39:25.704988 22225 raft_consensus.cc:2454] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 063fa962cd1747b59eaba0dfdf2dc8c3 in term 0.
I20260807 13:39:25.696100 22292 leader_election.cc:288] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:25.698168 22227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84a2737494bb45768d81f593432c7145" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" is_pre_election: true
I20260807 13:39:25.701524 22343 consensus_queue.cc:237] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.709723 21972 leader_election.cc:302] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 3bfc0ccff3be472ba85e284cb351d1bf; no voters: 7fa58ef028644655948f04747f2bde86
I20260807 13:39:25.698884 22324 leader_election.cc:288] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:25.712004 22292 raft_consensus.cc:2781] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:39:25.713855 22292 raft_consensus.cc:482] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:25.713626 22120 raft_consensus.cc:2454] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bfc0ccff3be472ba85e284cb351d1bf in term 1.
I20260807 13:39:25.715479 22292 raft_consensus.cc:3037] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:25.718159 21874 catalog_manager.cc:5495] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fa58ef028644655948f04747f2bde86 (127.21.82.66). New cstate: current_term: 1 leader_uuid: "7fa58ef028644655948f04747f2bde86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:25.730779 22075 leader_election.cc:302] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7fa58ef028644655948f04747f2bde86; no voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 3bfc0ccff3be472ba85e284cb351d1bf
I20260807 13:39:25.744504 22324 raft_consensus.cc:3037] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:25.756006 22292 raft_consensus.cc:504] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.761157 22292 leader_election.cc:288] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 1 election: Requested vote from peers 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:25.756640 22283 tablet_bootstrap.cc:654] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:25.764453 22227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "192a1c6675714a2f84c6512dcbafdf7f" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
I20260807 13:39:25.765929 22227 raft_consensus.cc:3037] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:25.764704 22324 raft_consensus.cc:2726] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:39:25.767553 22120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "192a1c6675714a2f84c6512dcbafdf7f" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fa58ef028644655948f04747f2bde86"
I20260807 13:39:25.767820 21875 catalog_manager.cc:5495] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67). New cstate: current_term: 1 leader_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } health_report { overall_health: HEALTHY } } }
W20260807 13:39:25.769462 21972 leader_election.cc:341] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:25.780932 22227 raft_consensus.cc:2454] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 063fa962cd1747b59eaba0dfdf2dc8c3 in term 1.
I20260807 13:39:25.782989 21972 leader_election.cc:302] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 3bfc0ccff3be472ba85e284cb351d1bf; no voters: 7fa58ef028644655948f04747f2bde86
I20260807 13:39:25.784495 22292 raft_consensus.cc:2781] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:39:25.784811 22284 tablet_bootstrap.cc:492] T 192a1c6675714a2f84c6512dcbafdf7f P 7fa58ef028644655948f04747f2bde86: No bootstrap required, opened a new log
I20260807 13:39:25.785441 22284 ts_tablet_manager.cc:1397] T 192a1c6675714a2f84c6512dcbafdf7f P 7fa58ef028644655948f04747f2bde86: Time spent bootstrapping tablet: real 0.135s user 0.015s sys 0.023s
I20260807 13:39:25.785416 22292 raft_consensus.cc:686] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 LEADER]: Becoming Leader. State: Replica: 063fa962cd1747b59eaba0dfdf2dc8c3, State: Running, Role: LEADER
I20260807 13:39:25.786409 22285 tablet_bootstrap.cc:492] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf: No bootstrap required, opened a new log
I20260807 13:39:25.787326 22285 ts_tablet_manager.cc:1397] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf: Time spent bootstrapping tablet: real 0.168s user 0.021s sys 0.016s
I20260807 13:39:25.786891 22292 consensus_queue.cc:237] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.790693 22284 raft_consensus.cc:348] T 192a1c6675714a2f84c6512dcbafdf7f P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.791637 22284 raft_consensus.cc:374] T 192a1c6675714a2f84c6512dcbafdf7f P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:25.792141 22284 raft_consensus.cc:729] T 192a1c6675714a2f84c6512dcbafdf7f P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fa58ef028644655948f04747f2bde86, State: Initialized, Role: FOLLOWER
I20260807 13:39:25.793431 22283 tablet_bootstrap.cc:492] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3: No bootstrap required, opened a new log
I20260807 13:39:25.793211 22284 consensus_queue.cc:260] T 192a1c6675714a2f84c6512dcbafdf7f P 7fa58ef028644655948f04747f2bde86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.794076 22283 ts_tablet_manager.cc:1397] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3: Time spent bootstrapping tablet: real 0.116s user 0.015s sys 0.019s
I20260807 13:39:25.794499 22294 raft_consensus.cc:482] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:25.795070 22294 raft_consensus.cc:504] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.797595 22294 leader_election.cc:288] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:25.799520 22014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e98d476a5144fa9bf7470cd679bd4bd" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" is_pre_election: true
I20260807 13:39:25.800349 22284 ts_tablet_manager.cc:1428] T 192a1c6675714a2f84c6512dcbafdf7f P 7fa58ef028644655948f04747f2bde86: Time spent starting tablet: real 0.014s user 0.006s sys 0.002s
I20260807 13:39:25.800336 22014 raft_consensus.cc:2454] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fa58ef028644655948f04747f2bde86 in term 0.
I20260807 13:39:25.801592 22284 tablet_bootstrap.cc:492] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86: Bootstrap starting.
I20260807 13:39:25.801805 22075 leader_election.cc:302] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 7fa58ef028644655948f04747f2bde86; no voters:
I20260807 13:39:25.802738 22294 raft_consensus.cc:2781] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:39:25.803170 22294 raft_consensus.cc:482] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:25.803565 22294 raft_consensus.cc:3037] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:25.803845 22285 raft_consensus.cc:348] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.804711 22285 raft_consensus.cc:374] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:25.805114 22227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e98d476a5144fa9bf7470cd679bd4bd" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" is_pre_election: true
W20260807 13:39:25.806562 22072 leader_election.cc:341] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:25.805095 22285 raft_consensus.cc:729] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bfc0ccff3be472ba85e284cb351d1bf, State: Initialized, Role: FOLLOWER
I20260807 13:39:25.813558 22285 consensus_queue.cc:260] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.814077 22294 raft_consensus.cc:504] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.798411 22283 raft_consensus.cc:348] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.815536 22283 raft_consensus.cc:374] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:25.818020 22014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e98d476a5144fa9bf7470cd679bd4bd" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
I20260807 13:39:25.818810 22014 raft_consensus.cc:3037] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:25.819898 22284 tablet_bootstrap.cc:654] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:25.824345 21875 catalog_manager.cc:5495] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65). New cstate: current_term: 1 leader_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:25.827680 22227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e98d476a5144fa9bf7470cd679bd4bd" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
W20260807 13:39:25.835572 22072 leader_election.cc:341] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:25.816113 22283 raft_consensus.cc:729] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 063fa962cd1747b59eaba0dfdf2dc8c3, State: Initialized, Role: FOLLOWER
I20260807 13:39:25.839560 22014 raft_consensus.cc:2454] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fa58ef028644655948f04747f2bde86 in term 1.
I20260807 13:39:25.838568 22283 consensus_queue.cc:260] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.840505 22285 ts_tablet_manager.cc:1428] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf: Time spent starting tablet: real 0.053s user 0.003s sys 0.008s
I20260807 13:39:25.843146 22285 tablet_bootstrap.cc:492] T 7e98d476a5144fa9bf7470cd679bd4bd P 3bfc0ccff3be472ba85e284cb351d1bf: Bootstrap starting.
I20260807 13:39:25.822263 22294 leader_election.cc:288] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 election: Requested vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:25.852403 22075 leader_election.cc:302] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 7fa58ef028644655948f04747f2bde86; no voters: 3bfc0ccff3be472ba85e284cb351d1bf
I20260807 13:39:25.853581 22294 raft_consensus.cc:2781] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:39:25.854566 22294 raft_consensus.cc:686] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [term 1 LEADER]: Becoming Leader. State: Replica: 7fa58ef028644655948f04747f2bde86, State: Running, Role: LEADER
I20260807 13:39:25.856103 22294 consensus_queue.cc:237] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.858489 22283 ts_tablet_manager.cc:1428] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3: Time spent starting tablet: real 0.064s user 0.005s sys 0.010s
I20260807 13:39:25.868729 22283 tablet_bootstrap.cc:492] T e18532a632434a23ba646b0c9af99180 P 063fa962cd1747b59eaba0dfdf2dc8c3: Bootstrap starting.
I20260807 13:39:25.869000 22324 consensus_queue.cc:1035] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:39:25.872455 22284 tablet_bootstrap.cc:492] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86: No bootstrap required, opened a new log
I20260807 13:39:25.873811 22285 tablet_bootstrap.cc:654] T 7e98d476a5144fa9bf7470cd679bd4bd P 3bfc0ccff3be472ba85e284cb351d1bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:25.879735 22014 raft_consensus.cc:3037] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:25.883044 22284 ts_tablet_manager.cc:1397] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86: Time spent bootstrapping tablet: real 0.082s user 0.009s sys 0.017s
I20260807 13:39:25.900717 22284 raft_consensus.cc:348] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.901631 22284 raft_consensus.cc:374] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:25.901942 22284 raft_consensus.cc:729] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fa58ef028644655948f04747f2bde86, State: Initialized, Role: FOLLOWER
I20260807 13:39:25.902746 22284 consensus_queue.cc:260] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.905105 22284 ts_tablet_manager.cc:1428] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86: Time spent starting tablet: real 0.020s user 0.005s sys 0.003s
I20260807 13:39:25.906013 22284 tablet_bootstrap.cc:492] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86: Bootstrap starting.
I20260807 13:39:25.928200 22343 raft_consensus.cc:482] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:25.928267 22297 consensus_queue.cc:1035] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:39:25.929064 22343 raft_consensus.cc:504] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.936846 22343 leader_election.cc:288] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193)
I20260807 13:39:25.939751 22120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e173a6d914a64a95badab506789de0fe" candidate_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fa58ef028644655948f04747f2bde86" is_pre_election: true
I20260807 13:39:25.940418 22016 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e173a6d914a64a95badab506789de0fe" candidate_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" is_pre_election: true
I20260807 13:39:25.936196 22324 consensus_queue.cc:1035] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:39:25.913885 21872 catalog_manager.cc:5495] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fa58ef028644655948f04747f2bde86 (127.21.82.66). New cstate: current_term: 1 leader_uuid: "7fa58ef028644655948f04747f2bde86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:25.946229 22324 raft_consensus.cc:482] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:25.941455 22016 raft_consensus.cc:2454] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bfc0ccff3be472ba85e284cb351d1bf in term 0.
I20260807 13:39:25.952098 22284 tablet_bootstrap.cc:654] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:25.980927 22370 raft_consensus.cc:482] T 192a1c6675714a2f84c6512dcbafdf7f P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:25.946928 22324 raft_consensus.cc:504] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
W20260807 13:39:25.951282 22177 leader_election.cc:341] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:25.982069 22370 raft_consensus.cc:504] T 192a1c6675714a2f84c6512dcbafdf7f P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:25.990631 22285 tablet_bootstrap.cc:492] T 7e98d476a5144fa9bf7470cd679bd4bd P 3bfc0ccff3be472ba85e284cb351d1bf: No bootstrap required, opened a new log
I20260807 13:39:25.992883 22012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "192a1c6675714a2f84c6512dcbafdf7f" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" is_pre_election: true
I20260807 13:39:25.994374 22370 leader_election.cc:288] T 192a1c6675714a2f84c6512dcbafdf7f P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:25.991200 22177 leader_election.cc:302] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 3bfc0ccff3be472ba85e284cb351d1bf; no voters: 7fa58ef028644655948f04747f2bde86
I20260807 13:39:25.998562 22324 leader_election.cc:288] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:25.995649 22285 ts_tablet_manager.cc:1397] T 7e98d476a5144fa9bf7470cd679bd4bd P 3bfc0ccff3be472ba85e284cb351d1bf: Time spent bootstrapping tablet: real 0.152s user 0.023s sys 0.039s
I20260807 13:39:26.000188 22012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f765d57daa445ac921adbf4e9cbda89" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" is_pre_election: true
I20260807 13:39:26.001355 22225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f765d57daa445ac921adbf4e9cbda89" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" is_pre_election: true
I20260807 13:39:26.003599 22227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "192a1c6675714a2f84c6512dcbafdf7f" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" is_pre_election: true
I20260807 13:39:26.004333 22227 raft_consensus.cc:2379] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7fa58ef028644655948f04747f2bde86 in current term 1: Already voted for candidate 063fa962cd1747b59eaba0dfdf2dc8c3 in this term.
I20260807 13:39:26.004987 22343 raft_consensus.cc:2781] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:39:26.005296 22343 raft_consensus.cc:482] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:26.005615 22343 raft_consensus.cc:3037] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:39:26.006891 22075 leader_election.cc:341] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:39:26.010877 22072 leader_election.cc:341] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:39:26.011933 22177 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:46193, user_credentials={real_user=slave}} blocked reactor thread for 64795.4us
I20260807 13:39:26.015203 22072 leader_election.cc:302] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7fa58ef028644655948f04747f2bde86; no voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 3bfc0ccff3be472ba85e284cb351d1bf
I20260807 13:39:26.016925 22324 raft_consensus.cc:2726] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:39:26.023905 22072 leader_election.cc:302] T 192a1c6675714a2f84c6512dcbafdf7f P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7fa58ef028644655948f04747f2bde86; no voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 3bfc0ccff3be472ba85e284cb351d1bf
I20260807 13:39:26.025022 22292 consensus_queue.cc:1035] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:39:26.027895 22283 tablet_bootstrap.cc:654] T e18532a632434a23ba646b0c9af99180 P 063fa962cd1747b59eaba0dfdf2dc8c3: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:26.032311 22324 raft_consensus.cc:3037] T 192a1c6675714a2f84c6512dcbafdf7f P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:39:26.045835 21972 consensus_peers.cc:487] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 -> Peer 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271): Couldn't send request to peer 3bfc0ccff3be472ba85e284cb351d1bf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:39:26.046105 22285 raft_consensus.cc:348] T 7e98d476a5144fa9bf7470cd679bd4bd P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:26.047320 22285 raft_consensus.cc:374] T 7e98d476a5144fa9bf7470cd679bd4bd P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:26.047740 22285 raft_consensus.cc:729] T 7e98d476a5144fa9bf7470cd679bd4bd P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bfc0ccff3be472ba85e284cb351d1bf, State: Initialized, Role: FOLLOWER
I20260807 13:39:26.048870 22285 consensus_queue.cc:260] T 7e98d476a5144fa9bf7470cd679bd4bd P 3bfc0ccff3be472ba85e284cb351d1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:26.041653 22343 raft_consensus.cc:504] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:26.056223 22285 ts_tablet_manager.cc:1428] T 7e98d476a5144fa9bf7470cd679bd4bd P 3bfc0ccff3be472ba85e284cb351d1bf: Time spent starting tablet: real 0.053s user 0.017s sys 0.004s
I20260807 13:39:26.064915 22347 consensus_queue.cc:1035] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260807 13:39:26.083938 22012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e173a6d914a64a95badab506789de0fe" candidate_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
I20260807 13:39:26.085062 22012 raft_consensus.cc:3037] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:26.088644 22285 tablet_bootstrap.cc:492] T 587be77f04c94532a0c5cff6fc7c638f P 3bfc0ccff3be472ba85e284cb351d1bf: Bootstrap starting.
I20260807 13:39:26.099411 22343 leader_election.cc:288] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 1 election: Requested vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193)
I20260807 13:39:26.100934 22324 raft_consensus.cc:2726] T 192a1c6675714a2f84c6512dcbafdf7f P 7fa58ef028644655948f04747f2bde86 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:39:26.108480 22118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e173a6d914a64a95badab506789de0fe" candidate_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fa58ef028644655948f04747f2bde86"
I20260807 13:39:26.116684 22284 tablet_bootstrap.cc:492] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86: No bootstrap required, opened a new log
I20260807 13:39:26.117358 22284 ts_tablet_manager.cc:1397] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86: Time spent bootstrapping tablet: real 0.212s user 0.019s sys 0.046s
I20260807 13:39:26.123649 22370 consensus_queue.cc:1035] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:39:26.130904 22284 raft_consensus.cc:348] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:26.131804 22284 raft_consensus.cc:374] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:26.132112 22284 raft_consensus.cc:729] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fa58ef028644655948f04747f2bde86, State: Initialized, Role: FOLLOWER
I20260807 13:39:26.135416 22284 consensus_queue.cc:260] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
W20260807 13:39:26.145494 22177 leader_election.cc:341] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:26.157982 22284 ts_tablet_manager.cc:1428] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86: Time spent starting tablet: real 0.040s user 0.008s sys 0.001s
W20260807 13:39:26.176347 22375 log.cc:924] Time spent T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86: Append to log took a long time: real 0.086s user 0.000s sys 0.001s
I20260807 13:39:26.179261 22285 tablet_bootstrap.cc:654] T 587be77f04c94532a0c5cff6fc7c638f P 3bfc0ccff3be472ba85e284cb351d1bf: Neither blocks nor log segments found. Creating new log.
W20260807 13:39:26.187351 22075 consensus_peers.cc:487] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 -> Peer 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001): Couldn't send request to peer 063fa962cd1747b59eaba0dfdf2dc8c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:39:26.202000 22343 consensus_queue.cc:1035] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:39:26.235108 22283 tablet_bootstrap.cc:492] T e18532a632434a23ba646b0c9af99180 P 063fa962cd1747b59eaba0dfdf2dc8c3: No bootstrap required, opened a new log
I20260807 13:39:26.243094 22283 ts_tablet_manager.cc:1397] T e18532a632434a23ba646b0c9af99180 P 063fa962cd1747b59eaba0dfdf2dc8c3: Time spent bootstrapping tablet: real 0.375s user 0.009s sys 0.057s
I20260807 13:39:26.247730 22343 consensus_queue.cc:1035] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:39:26.250536 22283 raft_consensus.cc:348] T e18532a632434a23ba646b0c9af99180 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:26.251650 22283 raft_consensus.cc:374] T e18532a632434a23ba646b0c9af99180 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:26.252032 22283 raft_consensus.cc:729] T e18532a632434a23ba646b0c9af99180 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 063fa962cd1747b59eaba0dfdf2dc8c3, State: Initialized, Role: FOLLOWER
I20260807 13:39:26.252704 22283 consensus_queue.cc:260] T e18532a632434a23ba646b0c9af99180 P 063fa962cd1747b59eaba0dfdf2dc8c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:26.255204 22283 ts_tablet_manager.cc:1428] T e18532a632434a23ba646b0c9af99180 P 063fa962cd1747b59eaba0dfdf2dc8c3: Time spent starting tablet: real 0.012s user 0.002s sys 0.008s
I20260807 13:39:26.256371 22283 tablet_bootstrap.cc:492] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3: Bootstrap starting.
I20260807 13:39:26.257745 22285 tablet_bootstrap.cc:492] T 587be77f04c94532a0c5cff6fc7c638f P 3bfc0ccff3be472ba85e284cb351d1bf: No bootstrap required, opened a new log
I20260807 13:39:26.258414 22285 ts_tablet_manager.cc:1397] T 587be77f04c94532a0c5cff6fc7c638f P 3bfc0ccff3be472ba85e284cb351d1bf: Time spent bootstrapping tablet: real 0.183s user 0.028s sys 0.030s
I20260807 13:39:26.268989 22283 tablet_bootstrap.cc:654] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:26.278132 22012 raft_consensus.cc:2454] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bfc0ccff3be472ba85e284cb351d1bf in term 1.
I20260807 13:39:26.282197 22180 leader_election.cc:302] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 3bfc0ccff3be472ba85e284cb351d1bf; no voters: 7fa58ef028644655948f04747f2bde86
I20260807 13:39:26.283847 22343 raft_consensus.cc:2781] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:39:26.284456 22343 raft_consensus.cc:686] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 LEADER]: Becoming Leader. State: Replica: 3bfc0ccff3be472ba85e284cb351d1bf, State: Running, Role: LEADER
I20260807 13:39:26.286023 22343 consensus_queue.cc:237] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:26.301223 22227 raft_consensus.cc:3037] T 7e98d476a5144fa9bf7470cd679bd4bd P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:39:26.313103 21939 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:39:26.315304 22285 raft_consensus.cc:348] T 587be77f04c94532a0c5cff6fc7c638f P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:26.317159 22285 raft_consensus.cc:374] T 587be77f04c94532a0c5cff6fc7c638f P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:26.317740 22285 raft_consensus.cc:729] T 587be77f04c94532a0c5cff6fc7c638f P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bfc0ccff3be472ba85e284cb351d1bf, State: Initialized, Role: FOLLOWER
I20260807 13:39:26.318536 22285 consensus_queue.cc:260] T 587be77f04c94532a0c5cff6fc7c638f P 3bfc0ccff3be472ba85e284cb351d1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:26.322431 22382 consensus_queue.cc:1035] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260807 13:39:26.334792 21875 catalog_manager.cc:5495] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67). New cstate: current_term: 1 leader_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } health_report { overall_health: HEALTHY } } }
I20260807 13:39:26.339807 22283 tablet_bootstrap.cc:492] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3: No bootstrap required, opened a new log
I20260807 13:39:26.340396 22283 ts_tablet_manager.cc:1397] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3: Time spent bootstrapping tablet: real 0.084s user 0.004s sys 0.013s
I20260807 13:39:26.340656 22285 ts_tablet_manager.cc:1428] T 587be77f04c94532a0c5cff6fc7c638f P 3bfc0ccff3be472ba85e284cb351d1bf: Time spent starting tablet: real 0.082s user 0.009s sys 0.000s
I20260807 13:39:26.341367 22285 tablet_bootstrap.cc:492] T 6f765d57daa445ac921adbf4e9cbda89 P 3bfc0ccff3be472ba85e284cb351d1bf: Bootstrap starting.
I20260807 13:39:26.339679 22294 consensus_queue.cc:1035] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260807 13:39:26.354485 22283 raft_consensus.cc:348] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:26.360884 22283 raft_consensus.cc:374] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:26.361254 22283 raft_consensus.cc:729] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 063fa962cd1747b59eaba0dfdf2dc8c3, State: Initialized, Role: FOLLOWER
I20260807 13:39:26.362015 22283 consensus_queue.cc:260] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:26.365077 22285 tablet_bootstrap.cc:654] T 6f765d57daa445ac921adbf4e9cbda89 P 3bfc0ccff3be472ba85e284cb351d1bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:26.397858 22283 ts_tablet_manager.cc:1428] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3: Time spent starting tablet: real 0.057s user 0.007s sys 0.002s
I20260807 13:39:26.402240 22225 raft_consensus.cc:3037] T 587be77f04c94532a0c5cff6fc7c638f P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:26.403829 22292 consensus_queue.cc:1035] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:39:26.412088 22294 consensus_queue.cc:1035] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:39:26.420555 22285 tablet_bootstrap.cc:492] T 6f765d57daa445ac921adbf4e9cbda89 P 3bfc0ccff3be472ba85e284cb351d1bf: No bootstrap required, opened a new log
I20260807 13:39:26.427594 22285 ts_tablet_manager.cc:1397] T 6f765d57daa445ac921adbf4e9cbda89 P 3bfc0ccff3be472ba85e284cb351d1bf: Time spent bootstrapping tablet: real 0.086s user 0.004s sys 0.025s
I20260807 13:39:26.432857 22285 raft_consensus.cc:348] T 6f765d57daa445ac921adbf4e9cbda89 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:26.433781 22285 raft_consensus.cc:374] T 6f765d57daa445ac921adbf4e9cbda89 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:26.434106 22285 raft_consensus.cc:729] T 6f765d57daa445ac921adbf4e9cbda89 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bfc0ccff3be472ba85e284cb351d1bf, State: Initialized, Role: FOLLOWER
I20260807 13:39:26.434962 22285 consensus_queue.cc:260] T 6f765d57daa445ac921adbf4e9cbda89 P 3bfc0ccff3be472ba85e284cb351d1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:26.438031 22285 ts_tablet_manager.cc:1428] T 6f765d57daa445ac921adbf4e9cbda89 P 3bfc0ccff3be472ba85e284cb351d1bf: Time spent starting tablet: real 0.010s user 0.005s sys 0.002s
I20260807 13:39:26.463729 22292 raft_consensus.cc:482] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:26.464309 22292 raft_consensus.cc:504] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:26.466257 22292 leader_election.cc:288] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:26.466990 22118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f765d57daa445ac921adbf4e9cbda89" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fa58ef028644655948f04747f2bde86" is_pre_election: true
I20260807 13:39:26.467658 22118 raft_consensus.cc:2454] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 063fa962cd1747b59eaba0dfdf2dc8c3 in term 0.
I20260807 13:39:26.468973 22227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f765d57daa445ac921adbf4e9cbda89" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" is_pre_election: true
I20260807 13:39:26.469013 21972 leader_election.cc:302] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 7fa58ef028644655948f04747f2bde86; no voters:
I20260807 13:39:26.469853 22227 raft_consensus.cc:2454] T 6f765d57daa445ac921adbf4e9cbda89 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 063fa962cd1747b59eaba0dfdf2dc8c3 in term 0.
I20260807 13:39:26.470745 22292 raft_consensus.cc:2781] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:39:26.472018 22292 raft_consensus.cc:482] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:26.472967 22292 raft_consensus.cc:3037] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:26.484093 22292 raft_consensus.cc:504] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:26.486156 22292 leader_election.cc:288] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 1 election: Requested vote from peers 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:26.487461 22118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f765d57daa445ac921adbf4e9cbda89" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fa58ef028644655948f04747f2bde86"
I20260807 13:39:26.488133 22118 raft_consensus.cc:3037] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:26.489691 22227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f765d57daa445ac921adbf4e9cbda89" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
I20260807 13:39:26.490674 22227 raft_consensus.cc:3037] T 6f765d57daa445ac921adbf4e9cbda89 P 3bfc0ccff3be472ba85e284cb351d1bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:26.500587 22118 raft_consensus.cc:2454] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 063fa962cd1747b59eaba0dfdf2dc8c3 in term 1.
I20260807 13:39:26.502449 21972 leader_election.cc:302] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 7fa58ef028644655948f04747f2bde86; no voters:
I20260807 13:39:26.503741 22292 raft_consensus.cc:2781] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:39:26.503890 22227 raft_consensus.cc:2454] T 6f765d57daa445ac921adbf4e9cbda89 P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 063fa962cd1747b59eaba0dfdf2dc8c3 in term 1.
I20260807 13:39:26.504895 22292 raft_consensus.cc:686] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 LEADER]: Becoming Leader. State: Replica: 063fa962cd1747b59eaba0dfdf2dc8c3, State: Running, Role: LEADER
I20260807 13:39:26.506155 22292 consensus_queue.cc:237] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:26.526511 22292 raft_consensus.cc:482] T e18532a632434a23ba646b0c9af99180 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:26.527170 22292 raft_consensus.cc:504] T e18532a632434a23ba646b0c9af99180 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:26.528767 22294 raft_consensus.cc:482] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:26.529407 22294 raft_consensus.cc:504] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:26.532554 22292 leader_election.cc:288] T e18532a632434a23ba646b0c9af99180 P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:26.533300 22014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e173a6d914a64a95badab506789de0fe" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" is_pre_election: true
I20260807 13:39:26.534214 22014 raft_consensus.cc:2379] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7fa58ef028644655948f04747f2bde86 in current term 1: Already voted for candidate 3bfc0ccff3be472ba85e284cb351d1bf in this term.
I20260807 13:39:26.535691 22294 leader_election.cc:288] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:26.537346 22225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e173a6d914a64a95badab506789de0fe" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" is_pre_election: true
I20260807 13:39:26.537863 22227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e18532a632434a23ba646b0c9af99180" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" is_pre_election: true
I20260807 13:39:26.534600 21872 catalog_manager.cc:5495] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65). New cstate: current_term: 1 leader_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:26.539556 22072 leader_election.cc:302] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7fa58ef028644655948f04747f2bde86; no voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 3bfc0ccff3be472ba85e284cb351d1bf
I20260807 13:39:26.534029 22118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e18532a632434a23ba646b0c9af99180" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fa58ef028644655948f04747f2bde86" is_pre_election: true
I20260807 13:39:26.542027 21972 leader_election.cc:302] T e18532a632434a23ba646b0c9af99180 P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 063fa962cd1747b59eaba0dfdf2dc8c3; no voters: 3bfc0ccff3be472ba85e284cb351d1bf, 7fa58ef028644655948f04747f2bde86
I20260807 13:39:26.542910 22294 raft_consensus.cc:3037] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:26.545130 22292 raft_consensus.cc:2726] T e18532a632434a23ba646b0c9af99180 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:39:26.553179 22294 raft_consensus.cc:2726] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:39:26.681774 22014 raft_consensus.cc:3037] T e18532a632434a23ba646b0c9af99180 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:26.781376 22118 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "efede11e063a479a9064465add093ed7"
dest_uuid: "7fa58ef028644655948f04747f2bde86"
mode: GRACEFUL
new_leader_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
from {username='slave'} at 127.0.0.1:37282
I20260807 13:39:26.782124 22118 raft_consensus.cc:595] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [term 1 LEADER]: Received request to transfer leadership to TS 063fa962cd1747b59eaba0dfdf2dc8c3
I20260807 13:39:26.802229 22227 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e173a6d914a64a95badab506789de0fe"
dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
mode: GRACEFUL
new_leader_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
from {username='slave'} at 127.0.0.1:47408
I20260807 13:39:26.802960 22227 raft_consensus.cc:595] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 LEADER]: Received request to transfer leadership to TS 063fa962cd1747b59eaba0dfdf2dc8c3
I20260807 13:39:26.809406 22227 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b930bdfd826e4d96b62ab161cae7bd44"
dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
mode: GRACEFUL
new_leader_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
from {username='slave'} at 127.0.0.1:47408
I20260807 13:39:26.809923 22227 raft_consensus.cc:595] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 LEADER]: Received request to transfer leadership to TS 063fa962cd1747b59eaba0dfdf2dc8c3
I20260807 13:39:26.815966 22227 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "84a2737494bb45768d81f593432c7145"
dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
mode: GRACEFUL
new_leader_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
from {username='slave'} at 127.0.0.1:47408
I20260807 13:39:26.816594 22227 raft_consensus.cc:595] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 LEADER]: Received request to transfer leadership to TS 063fa962cd1747b59eaba0dfdf2dc8c3
I20260807 13:39:26.818885 22347 consensus_queue.cc:1035] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:39:26.823329 22294 raft_consensus.cc:979] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86: : Instructing follower 063fa962cd1747b59eaba0dfdf2dc8c3 to start an election
I20260807 13:39:26.824234 22324 raft_consensus.cc:1067] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [term 1 LEADER]: Signalling peer 063fa962cd1747b59eaba0dfdf2dc8c3 to start an election
I20260807 13:39:26.827644 22012 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "efede11e063a479a9064465add093ed7"
dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
from {username='slave'} at 127.0.0.1:45576
I20260807 13:39:26.829372 22012 raft_consensus.cc:482] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:39:26.830065 22012 raft_consensus.cc:3037] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:26.838872 22297 raft_consensus.cc:979] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf: : Instructing follower 063fa962cd1747b59eaba0dfdf2dc8c3 to start an election
I20260807 13:39:26.839630 22343 raft_consensus.cc:1067] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 LEADER]: Signalling peer 063fa962cd1747b59eaba0dfdf2dc8c3 to start an election
I20260807 13:39:26.843744 22016 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e173a6d914a64a95badab506789de0fe"
dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
from {username='slave'} at 127.0.0.1:45564
I20260807 13:39:26.844761 22016 raft_consensus.cc:482] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:39:26.845395 22016 raft_consensus.cc:3037] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:26.857697 22347 consensus_queue.cc:1035] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:39:26.858860 22012 raft_consensus.cc:504] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:26.862774 22012 leader_election.cc:288] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 2 election: Requested vote from peers 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:26.865243 22227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efede11e063a479a9064465add093ed7" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
I20260807 13:39:26.866220 22227 raft_consensus.cc:3037] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:26.866308 22120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efede11e063a479a9064465add093ed7" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7fa58ef028644655948f04747f2bde86"
I20260807 13:39:26.867329 22120 raft_consensus.cc:3032] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:39:26.867856 22120 raft_consensus.cc:729] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7fa58ef028644655948f04747f2bde86, State: Running, Role: LEADER
I20260807 13:39:26.869153 22120 consensus_queue.cc:260] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:26.871220 22012 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6f765d57daa445ac921adbf4e9cbda89"
dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
mode: GRACEFUL
new_leader_uuid: "7fa58ef028644655948f04747f2bde86"
from {username='slave'} at 127.0.0.1:45592
I20260807 13:39:26.871869 22120 raft_consensus.cc:3037] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:26.872051 22012 raft_consensus.cc:595] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 LEADER]: Received request to transfer leadership to TS 7fa58ef028644655948f04747f2bde86
I20260807 13:39:26.879709 22016 raft_consensus.cc:504] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:26.888592 22012 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "587be77f04c94532a0c5cff6fc7c638f"
dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
mode: GRACEFUL
new_leader_uuid: "7fa58ef028644655948f04747f2bde86"
from {username='slave'} at 127.0.0.1:45592
I20260807 13:39:26.889307 22012 raft_consensus.cc:595] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 LEADER]: Received request to transfer leadership to TS 7fa58ef028644655948f04747f2bde86
I20260807 13:39:26.890483 22014 raft_consensus.cc:1226] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Rejecting Update request from peer 3bfc0ccff3be472ba85e284cb351d1bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:39:26.891322 22016 leader_election.cc:288] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 2 election: Requested vote from peers 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:26.893537 22227 raft_consensus.cc:2454] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 063fa962cd1747b59eaba0dfdf2dc8c3 in term 2.
I20260807 13:39:26.893651 22118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e173a6d914a64a95badab506789de0fe" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7fa58ef028644655948f04747f2bde86"
I20260807 13:39:26.894487 22118 raft_consensus.cc:3037] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:26.895821 22347 consensus_queue.cc:1046] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:39:26.896922 22343 raft_consensus.cc:3032] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:39:26.897476 22343 raft_consensus.cc:729] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3bfc0ccff3be472ba85e284cb351d1bf, State: Running, Role: LEADER
I20260807 13:39:26.898725 22343 consensus_queue.cc:260] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:26.900082 22343 raft_consensus.cc:3037] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:26.900272 22014 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "192a1c6675714a2f84c6512dcbafdf7f"
dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
mode: GRACEFUL
new_leader_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
from {username='slave'} at 127.0.0.1:45592
I20260807 13:39:26.901180 22014 raft_consensus.cc:595] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 LEADER]: Received request to transfer leadership to TS 3bfc0ccff3be472ba85e284cb351d1bf
I20260807 13:39:26.904521 21972 leader_election.cc:302] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 3bfc0ccff3be472ba85e284cb351d1bf; no voters:
I20260807 13:39:26.905002 22227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e173a6d914a64a95badab506789de0fe" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
I20260807 13:39:26.905797 22292 raft_consensus.cc:2781] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:39:26.906309 22292 raft_consensus.cc:686] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 LEADER]: Becoming Leader. State: Replica: 063fa962cd1747b59eaba0dfdf2dc8c3, State: Running, Role: LEADER
I20260807 13:39:26.906594 22120 raft_consensus.cc:2454] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 063fa962cd1747b59eaba0dfdf2dc8c3 in term 2.
I20260807 13:39:26.908201 22292 consensus_queue.cc:237] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:26.915299 22118 raft_consensus.cc:2454] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 063fa962cd1747b59eaba0dfdf2dc8c3 in term 2.
I20260807 13:39:26.920614 22227 raft_consensus.cc:2454] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 063fa962cd1747b59eaba0dfdf2dc8c3 in term 2.
I20260807 13:39:26.922156 21972 leader_election.cc:302] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 7fa58ef028644655948f04747f2bde86; no voters:
I20260807 13:39:26.922084 21872 catalog_manager.cc:5495] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3 reported cstate change: term changed from 1 to 2, leader changed from 7fa58ef028644655948f04747f2bde86 (127.21.82.66) to 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65). New cstate: current_term: 2 leader_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:26.924434 22334 raft_consensus.cc:2781] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:39:26.925197 22334 raft_consensus.cc:686] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 LEADER]: Becoming Leader. State: Replica: 063fa962cd1747b59eaba0dfdf2dc8c3, State: Running, Role: LEADER
I20260807 13:39:26.926481 22334 consensus_queue.cc:237] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:26.928911 22292 consensus_queue.cc:1035] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:39:26.943965 22334 raft_consensus.cc:979] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3: : Instructing follower 7fa58ef028644655948f04747f2bde86 to start an election
I20260807 13:39:26.944605 22292 raft_consensus.cc:1067] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 LEADER]: Signalling peer 7fa58ef028644655948f04747f2bde86 to start an election
I20260807 13:39:26.945504 21875 catalog_manager.cc:5495] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 reported cstate change: term changed from 1 to 2, leader changed from 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67) to 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65). New cstate: current_term: 2 leader_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:26.946769 22120 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "6f765d57daa445ac921adbf4e9cbda89"
dest_uuid: "7fa58ef028644655948f04747f2bde86"
from {username='slave'} at 127.0.0.1:37276
I20260807 13:39:26.947655 22120 raft_consensus.cc:482] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:39:26.948120 22120 raft_consensus.cc:3037] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:26.956161 22292 consensus_queue.cc:1035] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:39:26.958854 22120 raft_consensus.cc:504] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:26.960405 22118 raft_consensus.cc:1226] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Rejecting Update request from peer 063fa962cd1747b59eaba0dfdf2dc8c3 for earlier term 1. Current term is 2. Ops: []
I20260807 13:39:26.962924 22120 leader_election.cc:288] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 2 election: Requested vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:26.963331 22014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f765d57daa445ac921adbf4e9cbda89" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
I20260807 13:39:26.966959 22225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f765d57daa445ac921adbf4e9cbda89" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
I20260807 13:39:26.964174 22292 consensus_queue.cc:1046] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.004s
I20260807 13:39:26.970046 22014 raft_consensus.cc:3032] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:39:26.970387 22014 raft_consensus.cc:729] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 063fa962cd1747b59eaba0dfdf2dc8c3, State: Running, Role: LEADER
I20260807 13:39:26.971911 22014 consensus_queue.cc:260] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:26.972956 22014 raft_consensus.cc:3037] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:26.982371 22014 raft_consensus.cc:2454] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fa58ef028644655948f04747f2bde86 in term 2.
W20260807 13:39:26.983063 22334 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260807 13:39:26.987282 22075 leader_election.cc:302] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 7fa58ef028644655948f04747f2bde86; no voters: 3bfc0ccff3be472ba85e284cb351d1bf
I20260807 13:39:26.990206 22294 raft_consensus.cc:2781] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:39:26.990717 22294 raft_consensus.cc:686] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [term 2 LEADER]: Becoming Leader. State: Replica: 7fa58ef028644655948f04747f2bde86, State: Running, Role: LEADER
I20260807 13:39:26.991598 22294 consensus_queue.cc:237] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:27.004642 21874 catalog_manager.cc:5495] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 reported cstate change: term changed from 1 to 2, leader changed from 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65) to 7fa58ef028644655948f04747f2bde86 (127.21.82.66). New cstate: current_term: 2 leader_uuid: "7fa58ef028644655948f04747f2bde86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:27.024463 22292 raft_consensus.cc:979] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3: : Instructing follower 7fa58ef028644655948f04747f2bde86 to start an election
I20260807 13:39:27.025020 22410 raft_consensus.cc:1067] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 LEADER]: Signalling peer 7fa58ef028644655948f04747f2bde86 to start an election
I20260807 13:39:27.026983 22120 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "587be77f04c94532a0c5cff6fc7c638f"
dest_uuid: "7fa58ef028644655948f04747f2bde86"
from {username='slave'} at 127.0.0.1:37276
I20260807 13:39:27.027618 22120 raft_consensus.cc:482] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:39:27.028064 22120 raft_consensus.cc:3037] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:27.036468 22120 raft_consensus.cc:504] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:27.038985 22120 leader_election.cc:288] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 2 election: Requested vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:27.040268 22014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "587be77f04c94532a0c5cff6fc7c638f" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
I20260807 13:39:27.040512 22227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "587be77f04c94532a0c5cff6fc7c638f" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
I20260807 13:39:27.043321 22014 raft_consensus.cc:3032] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:39:27.043840 22227 raft_consensus.cc:3037] T 587be77f04c94532a0c5cff6fc7c638f P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:27.043802 22014 raft_consensus.cc:729] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 063fa962cd1747b59eaba0dfdf2dc8c3, State: Running, Role: LEADER
I20260807 13:39:27.045333 22014 consensus_queue.cc:260] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:27.047314 22014 raft_consensus.cc:3037] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:27.055431 22227 raft_consensus.cc:2454] T 587be77f04c94532a0c5cff6fc7c638f P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fa58ef028644655948f04747f2bde86 in term 2.
I20260807 13:39:27.057581 22072 leader_election.cc:302] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bfc0ccff3be472ba85e284cb351d1bf, 7fa58ef028644655948f04747f2bde86; no voters:
I20260807 13:39:27.057803 22014 raft_consensus.cc:2454] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fa58ef028644655948f04747f2bde86 in term 2.
I20260807 13:39:27.058815 22294 raft_consensus.cc:2781] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:39:27.059536 22294 raft_consensus.cc:686] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86 [term 2 LEADER]: Becoming Leader. State: Replica: 7fa58ef028644655948f04747f2bde86, State: Running, Role: LEADER
I20260807 13:39:27.060788 22294 consensus_queue.cc:237] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:27.070289 21874 catalog_manager.cc:5495] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86 reported cstate change: term changed from 1 to 2, leader changed from 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65) to 7fa58ef028644655948f04747f2bde86 (127.21.82.66). New cstate: current_term: 2 leader_uuid: "7fa58ef028644655948f04747f2bde86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:27.115569 22347 raft_consensus.cc:979] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf: : Instructing follower 063fa962cd1747b59eaba0dfdf2dc8c3 to start an election
I20260807 13:39:27.116221 22343 raft_consensus.cc:1067] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 LEADER]: Signalling peer 063fa962cd1747b59eaba0dfdf2dc8c3 to start an election
I20260807 13:39:27.118324 22014 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "84a2737494bb45768d81f593432c7145"
dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
from {username='slave'} at 127.0.0.1:45564
I20260807 13:39:27.119036 22014 raft_consensus.cc:482] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:39:27.119441 22014 raft_consensus.cc:3037] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:27.126340 22014 raft_consensus.cc:504] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:27.128613 22014 leader_election.cc:288] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 2 election: Requested vote from peers 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:27.130059 22120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84a2737494bb45768d81f593432c7145" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7fa58ef028644655948f04747f2bde86"
I20260807 13:39:27.130410 22227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84a2737494bb45768d81f593432c7145" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
I20260807 13:39:27.130833 22120 raft_consensus.cc:3037] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:27.131227 22227 raft_consensus.cc:3032] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:39:27.131666 22227 raft_consensus.cc:729] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3bfc0ccff3be472ba85e284cb351d1bf, State: Running, Role: LEADER
I20260807 13:39:27.132870 22227 consensus_queue.cc:260] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:27.134524 22227 raft_consensus.cc:3037] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:27.138123 22120 raft_consensus.cc:2454] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 063fa962cd1747b59eaba0dfdf2dc8c3 in term 2.
I20260807 13:39:27.139685 21972 leader_election.cc:302] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 7fa58ef028644655948f04747f2bde86; no voters:
I20260807 13:39:27.140748 22410 raft_consensus.cc:2781] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:39:27.141480 22410 raft_consensus.cc:686] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 LEADER]: Becoming Leader. State: Replica: 063fa962cd1747b59eaba0dfdf2dc8c3, State: Running, Role: LEADER
I20260807 13:39:27.142333 22227 raft_consensus.cc:2454] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 063fa962cd1747b59eaba0dfdf2dc8c3 in term 2.
I20260807 13:39:27.142793 22410 consensus_queue.cc:237] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:27.152436 21874 catalog_manager.cc:5495] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 reported cstate change: term changed from 1 to 2, leader changed from 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67) to 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65). New cstate: current_term: 2 leader_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:27.312650 22292 raft_consensus.cc:979] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3: : Instructing follower 3bfc0ccff3be472ba85e284cb351d1bf to start an election
I20260807 13:39:27.313103 22410 raft_consensus.cc:1067] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 LEADER]: Signalling peer 3bfc0ccff3be472ba85e284cb351d1bf to start an election
I20260807 13:39:27.314556 22227 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "192a1c6675714a2f84c6512dcbafdf7f"
dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
from {username='slave'} at 127.0.0.1:47400
I20260807 13:39:27.315122 22227 raft_consensus.cc:482] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:39:27.315438 22227 raft_consensus.cc:3037] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:27.320130 22227 raft_consensus.cc:504] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:27.321870 22227 leader_election.cc:288] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 2 election: Requested vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193)
I20260807 13:39:27.322835 22014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "192a1c6675714a2f84c6512dcbafdf7f" candidate_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
I20260807 13:39:27.323074 22120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "192a1c6675714a2f84c6512dcbafdf7f" candidate_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7fa58ef028644655948f04747f2bde86"
I20260807 13:39:27.323602 22120 raft_consensus.cc:3037] T 192a1c6675714a2f84c6512dcbafdf7f P 7fa58ef028644655948f04747f2bde86 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:27.323593 22014 raft_consensus.cc:3032] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:39:27.324189 22014 raft_consensus.cc:729] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 063fa962cd1747b59eaba0dfdf2dc8c3, State: Running, Role: LEADER
I20260807 13:39:27.324996 22014 consensus_queue.cc:260] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:27.326223 22014 raft_consensus.cc:3037] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:27.329205 22227 raft_consensus.cc:1261] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 FOLLOWER]: Refusing update from remote peer 063fa962cd1747b59eaba0dfdf2dc8c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:27.331216 22410 consensus_queue.cc:1035] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:27.333581 22343 raft_consensus.cc:979] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf: : Instructing follower 063fa962cd1747b59eaba0dfdf2dc8c3 to start an election
I20260807 13:39:27.333971 22120 raft_consensus.cc:2454] T 192a1c6675714a2f84c6512dcbafdf7f P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bfc0ccff3be472ba85e284cb351d1bf in term 2.
I20260807 13:39:27.334103 22343 raft_consensus.cc:1067] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 LEADER]: Signalling peer 063fa962cd1747b59eaba0dfdf2dc8c3 to start an election
I20260807 13:39:27.335243 22177 leader_election.cc:302] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bfc0ccff3be472ba85e284cb351d1bf, 7fa58ef028644655948f04747f2bde86; no voters:
I20260807 13:39:27.335449 22014 raft_consensus.cc:2454] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bfc0ccff3be472ba85e284cb351d1bf in term 2.
I20260807 13:39:27.336035 22016 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b930bdfd826e4d96b62ab161cae7bd44"
dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
from {username='slave'} at 127.0.0.1:45564
I20260807 13:39:27.336372 22347 raft_consensus.cc:2781] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:39:27.336683 22016 raft_consensus.cc:482] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:39:27.336860 22347 raft_consensus.cc:686] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 LEADER]: Becoming Leader. State: Replica: 3bfc0ccff3be472ba85e284cb351d1bf, State: Running, Role: LEADER
I20260807 13:39:27.337066 22016 raft_consensus.cc:3037] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:27.337715 22347 consensus_queue.cc:237] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:27.344997 22016 raft_consensus.cc:504] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:27.346999 22120 raft_consensus.cc:1261] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Refusing update from remote peer 063fa962cd1747b59eaba0dfdf2dc8c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:27.347152 22016 leader_election.cc:288] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 2 election: Requested vote from peers 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:27.347877 22118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b930bdfd826e4d96b62ab161cae7bd44" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7fa58ef028644655948f04747f2bde86"
I20260807 13:39:27.348557 22118 raft_consensus.cc:3037] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:27.348682 22227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b930bdfd826e4d96b62ab161cae7bd44" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
I20260807 13:39:27.349306 22227 raft_consensus.cc:3032] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:39:27.349084 22410 consensus_queue.cc:1035] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:27.349610 22227 raft_consensus.cc:729] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3bfc0ccff3be472ba85e284cb351d1bf, State: Running, Role: LEADER
I20260807 13:39:27.350500 22227 consensus_queue.cc:260] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:27.350579 21871 catalog_manager.cc:5495] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf reported cstate change: term changed from 1 to 2, leader changed from 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65) to 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67). New cstate: current_term: 2 leader_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } health_report { overall_health: HEALTHY } } }
I20260807 13:39:27.351724 22227 raft_consensus.cc:3037] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:27.355847 22118 raft_consensus.cc:2454] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 063fa962cd1747b59eaba0dfdf2dc8c3 in term 2.
I20260807 13:39:27.360620 22227 raft_consensus.cc:2454] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 063fa962cd1747b59eaba0dfdf2dc8c3 in term 2.
I20260807 13:39:27.362866 21972 leader_election.cc:302] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 7fa58ef028644655948f04747f2bde86; no voters:
I20260807 13:39:27.363708 22410 raft_consensus.cc:2781] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:39:27.365437 22410 raft_consensus.cc:686] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 LEADER]: Becoming Leader. State: Replica: 063fa962cd1747b59eaba0dfdf2dc8c3, State: Running, Role: LEADER
I20260807 13:39:27.366447 22410 consensus_queue.cc:237] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:27.374709 22120 raft_consensus.cc:1261] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Refusing update from remote peer 063fa962cd1747b59eaba0dfdf2dc8c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:27.376454 22410 consensus_queue.cc:1035] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:27.376662 21875 catalog_manager.cc:5495] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3 reported cstate change: term changed from 1 to 2, leader changed from 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67) to 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65). New cstate: current_term: 2 leader_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:27.391199 22227 raft_consensus.cc:1261] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 FOLLOWER]: Refusing update from remote peer 063fa962cd1747b59eaba0dfdf2dc8c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:27.394098 22227 raft_consensus.cc:3037] T 6f765d57daa445ac921adbf4e9cbda89 P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:27.394922 22016 raft_consensus.cc:1261] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Refusing update from remote peer 7fa58ef028644655948f04747f2bde86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:27.395864 22334 consensus_queue.cc:1035] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:27.397800 22324 consensus_queue.cc:1035] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:27.402524 22227 raft_consensus.cc:1261] T 6f765d57daa445ac921adbf4e9cbda89 P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 FOLLOWER]: Refusing update from remote peer 7fa58ef028644655948f04747f2bde86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:27.404425 22294 consensus_queue.cc:1035] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:27.509019 22225 raft_consensus.cc:1261] T 587be77f04c94532a0c5cff6fc7c638f P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 FOLLOWER]: Refusing update from remote peer 7fa58ef028644655948f04747f2bde86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:27.510371 22370 consensus_queue.cc:1035] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:27.519351 22016 raft_consensus.cc:1261] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Refusing update from remote peer 7fa58ef028644655948f04747f2bde86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:27.521375 22415 consensus_queue.cc:1035] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:27.587049 22225 raft_consensus.cc:1261] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 FOLLOWER]: Refusing update from remote peer 063fa962cd1747b59eaba0dfdf2dc8c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:27.588438 22334 consensus_queue.cc:1035] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:27.597481 22120 raft_consensus.cc:1261] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Refusing update from remote peer 063fa962cd1747b59eaba0dfdf2dc8c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:27.599632 22334 consensus_queue.cc:1035] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:27.807099 22120 raft_consensus.cc:1261] T 192a1c6675714a2f84c6512dcbafdf7f P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Refusing update from remote peer 3bfc0ccff3be472ba85e284cb351d1bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:27.808590 22347 consensus_queue.cc:1035] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:27.817386 22016 raft_consensus.cc:1261] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Refusing update from remote peer 3bfc0ccff3be472ba85e284cb351d1bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:27.820466 22343 consensus_queue.cc:1035] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:39:27.910849 22225 raft_consensus.cc:1261] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 FOLLOWER]: Refusing update from remote peer 063fa962cd1747b59eaba0dfdf2dc8c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:27.912139 22334 consensus_queue.cc:1035] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:27.922827 22120 raft_consensus.cc:1261] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Refusing update from remote peer 063fa962cd1747b59eaba0dfdf2dc8c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:27.926101 22334 consensus_queue.cc:1035] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:29.932552 21833 auto_leader_rebalancer-test.cc:269] The leader distribution is
I20260807 13:39:29.933501 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:39:29.958451 22120 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e18532a632434a23ba646b0c9af99180"
dest_uuid: "7fa58ef028644655948f04747f2bde86"
mode: GRACEFUL
new_leader_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
from {username='slave'} at 127.0.0.1:50116
I20260807 13:39:29.959270 22120 raft_consensus.cc:595] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 1 LEADER]: Received request to transfer leadership to TS 3bfc0ccff3be472ba85e284cb351d1bf
I20260807 13:39:29.972483 22016 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "efede11e063a479a9064465add093ed7"
dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
mode: GRACEFUL
new_leader_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
from {username='slave'} at 127.0.0.1:37174
I20260807 13:39:29.973179 22016 raft_consensus.cc:595] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 LEADER]: Received request to transfer leadership to TS 3bfc0ccff3be472ba85e284cb351d1bf
I20260807 13:39:29.974666 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260807 13:39:29.975379 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:39:30.227164 22292 raft_consensus.cc:979] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3: : Instructing follower 3bfc0ccff3be472ba85e284cb351d1bf to start an election
I20260807 13:39:30.227628 22437 raft_consensus.cc:1067] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 LEADER]: Signalling peer 3bfc0ccff3be472ba85e284cb351d1bf to start an election
I20260807 13:39:30.229121 22225 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "efede11e063a479a9064465add093ed7"
dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
from {username='slave'} at 127.0.0.1:47400
I20260807 13:39:30.229614 22225 raft_consensus.cc:482] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:39:30.230008 22225 raft_consensus.cc:3037] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:30.236202 22225 raft_consensus.cc:504] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:30.238003 22225 leader_election.cc:288] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 3 election: Requested vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193)
I20260807 13:39:30.239337 22120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efede11e063a479a9064465add093ed7" candidate_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7fa58ef028644655948f04747f2bde86"
I20260807 13:39:30.238925 22016 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efede11e063a479a9064465add093ed7" candidate_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
I20260807 13:39:30.239863 22120 raft_consensus.cc:3037] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:30.240262 22016 raft_consensus.cc:3032] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:39:30.240721 22016 raft_consensus.cc:729] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 063fa962cd1747b59eaba0dfdf2dc8c3, State: Running, Role: LEADER
I20260807 13:39:30.241581 22016 consensus_queue.cc:260] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:30.243299 22016 raft_consensus.cc:3037] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:30.246291 22120 raft_consensus.cc:2454] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bfc0ccff3be472ba85e284cb351d1bf in term 3.
I20260807 13:39:30.248119 22177 leader_election.cc:302] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bfc0ccff3be472ba85e284cb351d1bf, 7fa58ef028644655948f04747f2bde86; no voters:
I20260807 13:39:30.248963 22429 raft_consensus.cc:2781] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:39:30.251344 22429 raft_consensus.cc:686] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 LEADER]: Becoming Leader. State: Replica: 3bfc0ccff3be472ba85e284cb351d1bf, State: Running, Role: LEADER
I20260807 13:39:30.253127 22429 consensus_queue.cc:237] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:30.257383 22016 raft_consensus.cc:2454] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bfc0ccff3be472ba85e284cb351d1bf in term 3.
I20260807 13:39:30.267158 21874 catalog_manager.cc:5495] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf reported cstate change: term changed from 2 to 3, leader changed from 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65) to 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67). New cstate: current_term: 3 leader_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } health_report { overall_health: HEALTHY } } }
I20260807 13:39:30.586324 22450 raft_consensus.cc:979] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86: : Instructing follower 3bfc0ccff3be472ba85e284cb351d1bf to start an election
I20260807 13:39:30.587491 22447 raft_consensus.cc:1067] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 1 LEADER]: Signalling peer 3bfc0ccff3be472ba85e284cb351d1bf to start an election
I20260807 13:39:30.589640 22227 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e18532a632434a23ba646b0c9af99180"
dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
from {username='slave'} at 127.0.0.1:47398
I20260807 13:39:30.590304 22227 raft_consensus.cc:482] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:39:30.590721 22227 raft_consensus.cc:3037] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:30.596922 22227 raft_consensus.cc:504] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:30.599102 22227 leader_election.cc:288] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 2 election: Requested vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193)
I20260807 13:39:30.600288 22016 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e18532a632434a23ba646b0c9af99180" candidate_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
I20260807 13:39:30.600586 22120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e18532a632434a23ba646b0c9af99180" candidate_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7fa58ef028644655948f04747f2bde86"
I20260807 13:39:30.601231 22016 raft_consensus.cc:3037] T e18532a632434a23ba646b0c9af99180 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:30.601296 22120 raft_consensus.cc:3032] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:39:30.601686 22120 raft_consensus.cc:729] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7fa58ef028644655948f04747f2bde86, State: Running, Role: LEADER
I20260807 13:39:30.602401 22120 consensus_queue.cc:260] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:30.603698 22120 raft_consensus.cc:3037] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:30.607084 22016 raft_consensus.cc:2454] T e18532a632434a23ba646b0c9af99180 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bfc0ccff3be472ba85e284cb351d1bf in term 2.
I20260807 13:39:30.608474 22180 leader_election.cc:302] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 3bfc0ccff3be472ba85e284cb351d1bf; no voters:
I20260807 13:39:30.609319 22120 raft_consensus.cc:2454] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bfc0ccff3be472ba85e284cb351d1bf in term 2.
I20260807 13:39:30.609669 22429 raft_consensus.cc:2781] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:39:30.610169 22429 raft_consensus.cc:686] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 LEADER]: Becoming Leader. State: Replica: 3bfc0ccff3be472ba85e284cb351d1bf, State: Running, Role: LEADER
I20260807 13:39:30.611351 22429 consensus_queue.cc:237] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:30.622699 21874 catalog_manager.cc:5495] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf reported cstate change: term changed from 1 to 2, leader changed from 7fa58ef028644655948f04747f2bde86 (127.21.82.66) to 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67). New cstate: current_term: 2 leader_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } health_report { overall_health: HEALTHY } } }
I20260807 13:39:30.769961 22016 raft_consensus.cc:1261] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 3 FOLLOWER]: Refusing update from remote peer 3bfc0ccff3be472ba85e284cb351d1bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:39:30.771441 22429 consensus_queue.cc:1035] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:39:30.783435 22120 raft_consensus.cc:1261] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [term 3 FOLLOWER]: Refusing update from remote peer 3bfc0ccff3be472ba85e284cb351d1bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:39:30.786090 22429 consensus_queue.cc:1035] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:39:30.976418 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:39:30.981838 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:39:30.982263 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:39:31.103169 22016 raft_consensus.cc:1261] T e18532a632434a23ba646b0c9af99180 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Refusing update from remote peer 3bfc0ccff3be472ba85e284cb351d1bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:31.104451 22429 consensus_queue.cc:1035] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:31.115850 22120 raft_consensus.cc:1261] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Refusing update from remote peer 3bfc0ccff3be472ba85e284cb351d1bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:31.117537 22429 consensus_queue.cc:1035] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:31.983157 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:39:31.987855 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:39:31.988209 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:39:32.988958 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:39:32.993525 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:39:32.993889 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:39:33.994827 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:39:33.999559 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:39:33.999926 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:39:35.000625 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:39:35.005121 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:39:35.005473 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:39:36.006286 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:39:36.010932 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:39:36.011315 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:39:37.012153 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:39:37.017160 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:39:37.017614 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:39:38.018465 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:39:38.023039 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:39:38.023382 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:39:39.024116 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:39:39.028616 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:39:39.028981 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:39:40.063045 21833 auto_leader_rebalancer-test.cc:288] The leader distribution is
I20260807 13:39:40.068488 22227 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "efede11e063a479a9064465add093ed7"
dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
mode: GRACEFUL
new_leader_uuid: "7fa58ef028644655948f04747f2bde86"
from {username='slave'} at 127.0.0.1:47408
I20260807 13:39:40.069080 22227 raft_consensus.cc:595] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 LEADER]: Received request to transfer leadership to TS 7fa58ef028644655948f04747f2bde86
I20260807 13:39:40.075282 22014 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e173a6d914a64a95badab506789de0fe"
dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
mode: GRACEFUL
new_leader_uuid: "7fa58ef028644655948f04747f2bde86"
from {username='slave'} at 127.0.0.1:45592
I20260807 13:39:40.076001 22014 raft_consensus.cc:595] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 LEADER]: Received request to transfer leadership to TS 7fa58ef028644655948f04747f2bde86
I20260807 13:39:40.081565 22014 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b930bdfd826e4d96b62ab161cae7bd44"
dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
mode: GRACEFUL
new_leader_uuid: "7fa58ef028644655948f04747f2bde86"
from {username='slave'} at 127.0.0.1:45592
I20260807 13:39:40.082157 22014 raft_consensus.cc:595] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 LEADER]: Received request to transfer leadership to TS 7fa58ef028644655948f04747f2bde86
I20260807 13:39:40.087667 22014 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "84a2737494bb45768d81f593432c7145"
dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
mode: GRACEFUL
new_leader_uuid: "7fa58ef028644655948f04747f2bde86"
from {username='slave'} at 127.0.0.1:45592
I20260807 13:39:40.088404 22014 raft_consensus.cc:595] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 LEADER]: Received request to transfer leadership to TS 7fa58ef028644655948f04747f2bde86
I20260807 13:39:40.096644 22227 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e18532a632434a23ba646b0c9af99180"
dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
mode: GRACEFUL
new_leader_uuid: "7fa58ef028644655948f04747f2bde86"
from {username='slave'} at 127.0.0.1:47408
I20260807 13:39:40.097496 22227 raft_consensus.cc:595] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 LEADER]: Received request to transfer leadership to TS 7fa58ef028644655948f04747f2bde86
I20260807 13:39:40.101295 22479 raft_consensus.cc:979] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf: : Instructing follower 7fa58ef028644655948f04747f2bde86 to start an election
I20260807 13:39:40.102013 22429 raft_consensus.cc:1067] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 LEADER]: Signalling peer 7fa58ef028644655948f04747f2bde86 to start an election
I20260807 13:39:40.103495 22120 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e18532a632434a23ba646b0c9af99180"
dest_uuid: "7fa58ef028644655948f04747f2bde86"
from {username='slave'} at 127.0.0.1:37266
I20260807 13:39:40.104007 22120 raft_consensus.cc:482] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:39:40.104346 22120 raft_consensus.cc:3037] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:40.111507 22120 raft_consensus.cc:504] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:40.114743 22120 leader_election.cc:288] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 3 election: Requested vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:40.116573 22227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e18532a632434a23ba646b0c9af99180" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
I20260807 13:39:40.117285 22227 raft_consensus.cc:3032] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:39:40.117537 22227 raft_consensus.cc:729] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3bfc0ccff3be472ba85e284cb351d1bf, State: Running, Role: LEADER
I20260807 13:39:40.118108 22227 consensus_queue.cc:260] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:40.119040 22227 raft_consensus.cc:3037] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:40.123561 22014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e18532a632434a23ba646b0c9af99180" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
I20260807 13:39:40.123843 22227 raft_consensus.cc:2454] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fa58ef028644655948f04747f2bde86 in term 3.
I20260807 13:39:40.124346 22014 raft_consensus.cc:3037] T e18532a632434a23ba646b0c9af99180 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:40.125873 22072 leader_election.cc:302] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bfc0ccff3be472ba85e284cb351d1bf, 7fa58ef028644655948f04747f2bde86; no voters:
I20260807 13:39:40.127256 22478 raft_consensus.cc:2781] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:39:40.128700 22478 raft_consensus.cc:686] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 3 LEADER]: Becoming Leader. State: Replica: 7fa58ef028644655948f04747f2bde86, State: Running, Role: LEADER
I20260807 13:39:40.129587 22478 consensus_queue.cc:237] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:40.136989 22481 raft_consensus.cc:979] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3: : Instructing follower 7fa58ef028644655948f04747f2bde86 to start an election
I20260807 13:39:40.136857 22014 raft_consensus.cc:2454] T e18532a632434a23ba646b0c9af99180 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fa58ef028644655948f04747f2bde86 in term 3.
I20260807 13:39:40.138432 22471 raft_consensus.cc:1067] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 LEADER]: Signalling peer 7fa58ef028644655948f04747f2bde86 to start an election
I20260807 13:39:40.140545 22120 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e173a6d914a64a95badab506789de0fe"
dest_uuid: "7fa58ef028644655948f04747f2bde86"
from {username='slave'} at 127.0.0.1:37276
I20260807 13:39:40.141232 22120 raft_consensus.cc:482] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:39:40.141635 22120 raft_consensus.cc:3037] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:40.140571 21871 catalog_manager.cc:5495] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 reported cstate change: term changed from 2 to 3, leader changed from 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67) to 7fa58ef028644655948f04747f2bde86 (127.21.82.66). New cstate: current_term: 3 leader_uuid: "7fa58ef028644655948f04747f2bde86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:40.147433 22120 raft_consensus.cc:504] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:40.148867 22120 leader_election.cc:288] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 3 election: Requested vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:40.150193 22227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e173a6d914a64a95badab506789de0fe" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
I20260807 13:39:40.150854 22227 raft_consensus.cc:3037] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:40.151124 22014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e173a6d914a64a95badab506789de0fe" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
I20260807 13:39:40.152930 22014 raft_consensus.cc:3032] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:39:40.153470 22014 raft_consensus.cc:729] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 063fa962cd1747b59eaba0dfdf2dc8c3, State: Running, Role: LEADER
I20260807 13:39:40.154795 22014 consensus_queue.cc:260] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:40.157464 22014 raft_consensus.cc:3037] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:40.158751 22227 raft_consensus.cc:2454] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fa58ef028644655948f04747f2bde86 in term 3.
I20260807 13:39:40.160533 22072 leader_election.cc:302] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bfc0ccff3be472ba85e284cb351d1bf, 7fa58ef028644655948f04747f2bde86; no voters:
I20260807 13:39:40.161649 22478 raft_consensus.cc:2781] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:39:40.162243 22478 raft_consensus.cc:686] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86 [term 3 LEADER]: Becoming Leader. State: Replica: 7fa58ef028644655948f04747f2bde86, State: Running, Role: LEADER
I20260807 13:39:40.164683 22014 raft_consensus.cc:2454] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fa58ef028644655948f04747f2bde86 in term 3.
I20260807 13:39:40.163836 22478 consensus_queue.cc:237] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:40.180073 21871 catalog_manager.cc:5495] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86 reported cstate change: term changed from 2 to 3, leader changed from 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65) to 7fa58ef028644655948f04747f2bde86 (127.21.82.66). New cstate: current_term: 3 leader_uuid: "7fa58ef028644655948f04747f2bde86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:40.263002 22481 raft_consensus.cc:979] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3: : Instructing follower 7fa58ef028644655948f04747f2bde86 to start an election
I20260807 13:39:40.263638 22471 raft_consensus.cc:1067] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 LEADER]: Signalling peer 7fa58ef028644655948f04747f2bde86 to start an election
I20260807 13:39:40.265537 22120 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b930bdfd826e4d96b62ab161cae7bd44"
dest_uuid: "7fa58ef028644655948f04747f2bde86"
from {username='slave'} at 127.0.0.1:37276
I20260807 13:39:40.266016 22120 raft_consensus.cc:482] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:39:40.266292 22120 raft_consensus.cc:3037] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:40.270515 22120 raft_consensus.cc:504] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:40.272135 22120 leader_election.cc:288] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 3 election: Requested vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:40.273368 22014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b930bdfd826e4d96b62ab161cae7bd44" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
I20260807 13:39:40.273471 22227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b930bdfd826e4d96b62ab161cae7bd44" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
I20260807 13:39:40.274086 22227 raft_consensus.cc:3037] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:40.274075 22014 raft_consensus.cc:3032] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:39:40.274677 22014 raft_consensus.cc:729] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 063fa962cd1747b59eaba0dfdf2dc8c3, State: Running, Role: LEADER
I20260807 13:39:40.275501 22014 consensus_queue.cc:260] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:40.276791 22014 raft_consensus.cc:3037] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:40.281324 22227 raft_consensus.cc:2454] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fa58ef028644655948f04747f2bde86 in term 3.
I20260807 13:39:40.282608 22072 leader_election.cc:302] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bfc0ccff3be472ba85e284cb351d1bf, 7fa58ef028644655948f04747f2bde86; no voters:
I20260807 13:39:40.283450 22478 raft_consensus.cc:2781] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:39:40.283958 22014 raft_consensus.cc:2454] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fa58ef028644655948f04747f2bde86 in term 3.
I20260807 13:39:40.284015 22478 raft_consensus.cc:686] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 [term 3 LEADER]: Becoming Leader. State: Replica: 7fa58ef028644655948f04747f2bde86, State: Running, Role: LEADER
I20260807 13:39:40.285441 22478 consensus_queue.cc:237] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:40.293952 21871 catalog_manager.cc:5495] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 reported cstate change: term changed from 2 to 3, leader changed from 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65) to 7fa58ef028644655948f04747f2bde86 (127.21.82.66). New cstate: current_term: 3 leader_uuid: "7fa58ef028644655948f04747f2bde86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:40.350916 22479 raft_consensus.cc:979] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf: : Instructing follower 7fa58ef028644655948f04747f2bde86 to start an election
I20260807 13:39:40.351485 22429 raft_consensus.cc:1067] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 LEADER]: Signalling peer 7fa58ef028644655948f04747f2bde86 to start an election
I20260807 13:39:40.352829 22120 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "efede11e063a479a9064465add093ed7"
dest_uuid: "7fa58ef028644655948f04747f2bde86"
from {username='slave'} at 127.0.0.1:37266
I20260807 13:39:40.353291 22120 raft_consensus.cc:482] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:39:40.353669 22120 raft_consensus.cc:3037] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:40.358985 22120 raft_consensus.cc:504] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:40.360738 22120 leader_election.cc:288] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 4 election: Requested vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:40.361719 22014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efede11e063a479a9064465add093ed7" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
I20260807 13:39:40.362335 22014 raft_consensus.cc:3037] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:40.363214 22481 raft_consensus.cc:979] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3: : Instructing follower 7fa58ef028644655948f04747f2bde86 to start an election
I20260807 13:39:40.362267 22227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efede11e063a479a9064465add093ed7" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
I20260807 13:39:40.363819 22227 raft_consensus.cc:3032] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:39:40.364120 22227 raft_consensus.cc:729] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3bfc0ccff3be472ba85e284cb351d1bf, State: Running, Role: LEADER
I20260807 13:39:40.363857 22471 raft_consensus.cc:1067] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 LEADER]: Signalling peer 7fa58ef028644655948f04747f2bde86 to start an election
I20260807 13:39:40.364847 22227 consensus_queue.cc:260] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:40.366243 22227 raft_consensus.cc:3037] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:40.367066 22118 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "84a2737494bb45768d81f593432c7145"
dest_uuid: "7fa58ef028644655948f04747f2bde86"
from {username='slave'} at 127.0.0.1:37276
I20260807 13:39:40.367782 22118 raft_consensus.cc:482] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:39:40.368322 22014 raft_consensus.cc:2454] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fa58ef028644655948f04747f2bde86 in term 4.
I20260807 13:39:40.368208 22118 raft_consensus.cc:3037] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:40.370216 22075 leader_election.cc:302] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 7fa58ef028644655948f04747f2bde86; no voters:
I20260807 13:39:40.371510 22478 raft_consensus.cc:2781] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:39:40.372164 22478 raft_consensus.cc:686] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [term 4 LEADER]: Becoming Leader. State: Replica: 7fa58ef028644655948f04747f2bde86, State: Running, Role: LEADER
I20260807 13:39:40.372413 22227 raft_consensus.cc:2454] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fa58ef028644655948f04747f2bde86 in term 4.
I20260807 13:39:40.373411 22478 consensus_queue.cc:237] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:40.378139 22118 raft_consensus.cc:504] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:40.381467 22118 leader_election.cc:288] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 3 election: Requested vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:40.382637 22227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84a2737494bb45768d81f593432c7145" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
I20260807 13:39:40.383131 22227 raft_consensus.cc:3037] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:40.383436 21871 catalog_manager.cc:5495] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 reported cstate change: term changed from 3 to 4, leader changed from 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67) to 7fa58ef028644655948f04747f2bde86 (127.21.82.66). New cstate: current_term: 4 leader_uuid: "7fa58ef028644655948f04747f2bde86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:40.387291 22014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84a2737494bb45768d81f593432c7145" candidate_uuid: "7fa58ef028644655948f04747f2bde86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
I20260807 13:39:40.387741 22227 raft_consensus.cc:2454] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fa58ef028644655948f04747f2bde86 in term 3.
I20260807 13:39:40.388259 22014 raft_consensus.cc:3032] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:39:40.388715 22014 raft_consensus.cc:729] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 063fa962cd1747b59eaba0dfdf2dc8c3, State: Running, Role: LEADER
I20260807 13:39:40.389294 22072 leader_election.cc:302] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bfc0ccff3be472ba85e284cb351d1bf, 7fa58ef028644655948f04747f2bde86; no voters:
I20260807 13:39:40.389394 22014 consensus_queue.cc:260] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:40.390321 22478 raft_consensus.cc:2781] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:39:40.390753 22014 raft_consensus.cc:3037] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:40.391158 22478 raft_consensus.cc:686] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [term 3 LEADER]: Becoming Leader. State: Replica: 7fa58ef028644655948f04747f2bde86, State: Running, Role: LEADER
I20260807 13:39:40.393034 22478 consensus_queue.cc:237] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:40.399724 22014 raft_consensus.cc:2454] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fa58ef028644655948f04747f2bde86 in term 3.
I20260807 13:39:40.403054 21871 catalog_manager.cc:5495] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 reported cstate change: term changed from 2 to 3, leader changed from 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65) to 7fa58ef028644655948f04747f2bde86 (127.21.82.66). New cstate: current_term: 3 leader_uuid: "7fa58ef028644655948f04747f2bde86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:40.562724 22014 raft_consensus.cc:1261] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 3 FOLLOWER]: Refusing update from remote peer 7fa58ef028644655948f04747f2bde86: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:39:40.564527 22483 consensus_queue.cc:1035] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:39:40.576828 22227 raft_consensus.cc:1261] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 FOLLOWER]: Refusing update from remote peer 7fa58ef028644655948f04747f2bde86: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:39:40.578621 22498 consensus_queue.cc:1035] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:39:40.668911 22014 raft_consensus.cc:1261] T e18532a632434a23ba646b0c9af99180 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 3 FOLLOWER]: Refusing update from remote peer 7fa58ef028644655948f04747f2bde86: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:39:40.670578 22498 consensus_queue.cc:1035] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:39:40.683036 22227 raft_consensus.cc:1261] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 FOLLOWER]: Refusing update from remote peer 7fa58ef028644655948f04747f2bde86: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:39:40.684921 22483 consensus_queue.cc:1035] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:39:40.720420 22014 raft_consensus.cc:1261] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 3 FOLLOWER]: Refusing update from remote peer 7fa58ef028644655948f04747f2bde86: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:39:40.721598 22498 consensus_queue.cc:1035] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:39:40.733551 22227 raft_consensus.cc:1261] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 FOLLOWER]: Refusing update from remote peer 7fa58ef028644655948f04747f2bde86: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:39:40.735399 22483 consensus_queue.cc:1035] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:39:40.788992 22227 raft_consensus.cc:1261] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [term 4 FOLLOWER]: Refusing update from remote peer 7fa58ef028644655948f04747f2bde86: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 13:39:40.791009 22483 consensus_queue.cc:1035] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:39:40.819790 22014 raft_consensus.cc:1261] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 4 FOLLOWER]: Refusing update from remote peer 7fa58ef028644655948f04747f2bde86: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 13:39:40.825595 22498 consensus_queue.cc:1035] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260807 13:39:40.937577 22014 raft_consensus.cc:1261] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 3 FOLLOWER]: Refusing update from remote peer 7fa58ef028644655948f04747f2bde86: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:39:40.941797 22498 consensus_queue.cc:1035] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:39:40.970062 22227 raft_consensus.cc:1261] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 FOLLOWER]: Refusing update from remote peer 7fa58ef028644655948f04747f2bde86: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:39:40.974339 22483 consensus_queue.cc:1035] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:39:43.139022 21833 auto_leader_rebalancer-test.cc:303] The leader distribution is
I20260807 13:39:43.139843 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:39:43.148392 22118 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "587be77f04c94532a0c5cff6fc7c638f"
dest_uuid: "7fa58ef028644655948f04747f2bde86"
mode: GRACEFUL
new_leader_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
from {username='slave'} at 127.0.0.1:50116
I20260807 13:39:43.149087 22118 raft_consensus.cc:595] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86 [term 2 LEADER]: Received request to transfer leadership to TS 063fa962cd1747b59eaba0dfdf2dc8c3
I20260807 13:39:43.151918 22118 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6f765d57daa445ac921adbf4e9cbda89"
dest_uuid: "7fa58ef028644655948f04747f2bde86"
mode: GRACEFUL
new_leader_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
from {username='slave'} at 127.0.0.1:50116
I20260807 13:39:43.152616 22118 raft_consensus.cc:595] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [term 2 LEADER]: Received request to transfer leadership to TS 063fa962cd1747b59eaba0dfdf2dc8c3
I20260807 13:39:43.154913 22118 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7e98d476a5144fa9bf7470cd679bd4bd"
dest_uuid: "7fa58ef028644655948f04747f2bde86"
mode: GRACEFUL
new_leader_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
from {username='slave'} at 127.0.0.1:50116
I20260807 13:39:43.155408 22118 raft_consensus.cc:595] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [term 1 LEADER]: Received request to transfer leadership to TS 063fa962cd1747b59eaba0dfdf2dc8c3
I20260807 13:39:43.157548 22118 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "84a2737494bb45768d81f593432c7145"
dest_uuid: "7fa58ef028644655948f04747f2bde86"
mode: GRACEFUL
new_leader_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
from {username='slave'} at 127.0.0.1:50116
I20260807 13:39:43.158082 22118 raft_consensus.cc:595] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [term 3 LEADER]: Received request to transfer leadership to TS 3bfc0ccff3be472ba85e284cb351d1bf
I20260807 13:39:43.160352 22118 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e18532a632434a23ba646b0c9af99180"
dest_uuid: "7fa58ef028644655948f04747f2bde86"
mode: GRACEFUL
new_leader_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
from {username='slave'} at 127.0.0.1:50116
I20260807 13:39:43.160897 22118 raft_consensus.cc:595] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 3 LEADER]: Received request to transfer leadership to TS 3bfc0ccff3be472ba85e284cb351d1bf
I20260807 13:39:43.162024 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260807 13:39:43.162510 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:39:43.422400 22522 raft_consensus.cc:979] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86: : Instructing follower 063fa962cd1747b59eaba0dfdf2dc8c3 to start an election
I20260807 13:39:43.423022 22498 raft_consensus.cc:1067] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86 [term 2 LEADER]: Signalling peer 063fa962cd1747b59eaba0dfdf2dc8c3 to start an election
I20260807 13:39:43.424468 22014 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "587be77f04c94532a0c5cff6fc7c638f"
dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
from {username='slave'} at 127.0.0.1:45576
I20260807 13:39:43.424937 22014 raft_consensus.cc:482] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:39:43.425263 22014 raft_consensus.cc:3037] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:43.431241 22014 raft_consensus.cc:504] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:43.433749 22014 leader_election.cc:288] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 3 election: Requested vote from peers 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:43.434691 22118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "587be77f04c94532a0c5cff6fc7c638f" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7fa58ef028644655948f04747f2bde86"
I20260807 13:39:43.435408 22118 raft_consensus.cc:3032] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:39:43.435348 22225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "587be77f04c94532a0c5cff6fc7c638f" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
I20260807 13:39:43.435886 22225 raft_consensus.cc:3037] T 587be77f04c94532a0c5cff6fc7c638f P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:43.440987 22225 raft_consensus.cc:2454] T 587be77f04c94532a0c5cff6fc7c638f P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 063fa962cd1747b59eaba0dfdf2dc8c3 in term 3.
I20260807 13:39:43.441365 22118 raft_consensus.cc:729] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7fa58ef028644655948f04747f2bde86, State: Running, Role: LEADER
I20260807 13:39:43.442474 21972 leader_election.cc:302] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 3bfc0ccff3be472ba85e284cb351d1bf; no voters:
I20260807 13:39:43.442401 22118 consensus_queue.cc:260] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:43.443701 22118 raft_consensus.cc:3037] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:43.444394 22523 raft_consensus.cc:2781] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:39:43.445459 22523 raft_consensus.cc:686] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 3 LEADER]: Becoming Leader. State: Replica: 063fa962cd1747b59eaba0dfdf2dc8c3, State: Running, Role: LEADER
I20260807 13:39:43.446334 22523 consensus_queue.cc:237] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:43.450341 22118 raft_consensus.cc:2454] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 063fa962cd1747b59eaba0dfdf2dc8c3 in term 3.
I20260807 13:39:43.457229 21874 catalog_manager.cc:5495] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 reported cstate change: term changed from 2 to 3, leader changed from 7fa58ef028644655948f04747f2bde86 (127.21.82.66) to 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65). New cstate: current_term: 3 leader_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:43.463382 22522 raft_consensus.cc:979] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86: : Instructing follower 063fa962cd1747b59eaba0dfdf2dc8c3 to start an election
I20260807 13:39:43.463940 22498 raft_consensus.cc:1067] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [term 2 LEADER]: Signalling peer 063fa962cd1747b59eaba0dfdf2dc8c3 to start an election
I20260807 13:39:43.465651 22014 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "6f765d57daa445ac921adbf4e9cbda89"
dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
from {username='slave'} at 127.0.0.1:45576
I20260807 13:39:43.466172 22014 raft_consensus.cc:482] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:39:43.466534 22014 raft_consensus.cc:3037] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:43.473414 22014 raft_consensus.cc:504] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:43.475299 22014 leader_election.cc:288] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 3 election: Requested vote from peers 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:43.476300 22225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f765d57daa445ac921adbf4e9cbda89" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
I20260807 13:39:43.476781 22225 raft_consensus.cc:3037] T 6f765d57daa445ac921adbf4e9cbda89 P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:43.476714 22118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f765d57daa445ac921adbf4e9cbda89" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7fa58ef028644655948f04747f2bde86"
I20260807 13:39:43.477344 22118 raft_consensus.cc:3032] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:39:43.477624 22118 raft_consensus.cc:729] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7fa58ef028644655948f04747f2bde86, State: Running, Role: LEADER
I20260807 13:39:43.478317 22118 consensus_queue.cc:260] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:43.479347 22118 raft_consensus.cc:3037] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:43.481781 22225 raft_consensus.cc:2454] T 6f765d57daa445ac921adbf4e9cbda89 P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 063fa962cd1747b59eaba0dfdf2dc8c3 in term 3.
I20260807 13:39:43.482810 21972 leader_election.cc:302] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 3bfc0ccff3be472ba85e284cb351d1bf; no voters:
I20260807 13:39:43.483537 22523 raft_consensus.cc:2781] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:39:43.484041 22523 raft_consensus.cc:686] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 3 LEADER]: Becoming Leader. State: Replica: 063fa962cd1747b59eaba0dfdf2dc8c3, State: Running, Role: LEADER
I20260807 13:39:43.485065 22118 raft_consensus.cc:2454] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 063fa962cd1747b59eaba0dfdf2dc8c3 in term 3.
I20260807 13:39:43.484931 22523 consensus_queue.cc:237] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:43.489938 22522 raft_consensus.cc:979] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86: : Instructing follower 3bfc0ccff3be472ba85e284cb351d1bf to start an election
I20260807 13:39:43.490485 22498 raft_consensus.cc:1067] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 3 LEADER]: Signalling peer 3bfc0ccff3be472ba85e284cb351d1bf to start an election
I20260807 13:39:43.492036 22225 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e18532a632434a23ba646b0c9af99180"
dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
from {username='slave'} at 127.0.0.1:47398
I20260807 13:39:43.492620 22225 raft_consensus.cc:482] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:39:43.492982 22225 raft_consensus.cc:3037] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:43.493784 21874 catalog_manager.cc:5495] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 reported cstate change: term changed from 2 to 3, leader changed from 7fa58ef028644655948f04747f2bde86 (127.21.82.66) to 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65). New cstate: current_term: 3 leader_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:43.498890 22225 raft_consensus.cc:504] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:43.501608 22225 leader_election.cc:288] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 4 election: Requested vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193)
I20260807 13:39:43.502738 22118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e18532a632434a23ba646b0c9af99180" candidate_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7fa58ef028644655948f04747f2bde86"
I20260807 13:39:43.502795 22014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e18532a632434a23ba646b0c9af99180" candidate_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
I20260807 13:39:43.503476 22118 raft_consensus.cc:3032] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:39:43.503538 22014 raft_consensus.cc:3037] T e18532a632434a23ba646b0c9af99180 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:43.503948 22118 raft_consensus.cc:729] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7fa58ef028644655948f04747f2bde86, State: Running, Role: LEADER
I20260807 13:39:43.504793 22118 consensus_queue.cc:260] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:43.505671 22118 raft_consensus.cc:3037] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:43.510196 22118 raft_consensus.cc:2454] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bfc0ccff3be472ba85e284cb351d1bf in term 4.
I20260807 13:39:43.510272 22014 raft_consensus.cc:2454] T e18532a632434a23ba646b0c9af99180 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bfc0ccff3be472ba85e284cb351d1bf in term 4.
I20260807 13:39:43.511732 22177 leader_election.cc:302] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bfc0ccff3be472ba85e284cb351d1bf, 7fa58ef028644655948f04747f2bde86; no voters:
I20260807 13:39:43.512576 22429 raft_consensus.cc:2781] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:39:43.513581 22429 raft_consensus.cc:686] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [term 4 LEADER]: Becoming Leader. State: Replica: 3bfc0ccff3be472ba85e284cb351d1bf, State: Running, Role: LEADER
I20260807 13:39:43.514338 22429 consensus_queue.cc:237] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:43.519666 22522 raft_consensus.cc:979] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86: : Instructing follower 3bfc0ccff3be472ba85e284cb351d1bf to start an election
I20260807 13:39:43.520165 22498 raft_consensus.cc:1067] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [term 3 LEADER]: Signalling peer 3bfc0ccff3be472ba85e284cb351d1bf to start an election
I20260807 13:39:43.521579 22225 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "84a2737494bb45768d81f593432c7145"
dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
from {username='slave'} at 127.0.0.1:47398
I20260807 13:39:43.522019 22225 raft_consensus.cc:482] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:39:43.522339 22225 raft_consensus.cc:3037] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:43.522055 21874 catalog_manager.cc:5495] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf reported cstate change: term changed from 3 to 4, leader changed from 7fa58ef028644655948f04747f2bde86 (127.21.82.66) to 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67). New cstate: current_term: 4 leader_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } health_report { overall_health: HEALTHY } } }
I20260807 13:39:43.527868 22225 raft_consensus.cc:504] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:43.529526 22225 leader_election.cc:288] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 4 election: Requested vote from peers 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001), 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193)
I20260807 13:39:43.530275 22014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84a2737494bb45768d81f593432c7145" candidate_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
I20260807 13:39:43.530570 22118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84a2737494bb45768d81f593432c7145" candidate_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7fa58ef028644655948f04747f2bde86"
I20260807 13:39:43.531325 22014 raft_consensus.cc:3037] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:43.531407 22118 raft_consensus.cc:3032] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:39:43.531813 22118 raft_consensus.cc:729] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7fa58ef028644655948f04747f2bde86, State: Running, Role: LEADER
I20260807 13:39:43.532565 22118 consensus_queue.cc:260] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:43.533805 22118 raft_consensus.cc:3037] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:43.537529 22014 raft_consensus.cc:2454] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bfc0ccff3be472ba85e284cb351d1bf in term 4.
I20260807 13:39:43.538575 22180 leader_election.cc:302] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 3bfc0ccff3be472ba85e284cb351d1bf; no voters:
I20260807 13:39:43.539301 22429 raft_consensus.cc:2781] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:39:43.539780 22118 raft_consensus.cc:2454] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bfc0ccff3be472ba85e284cb351d1bf in term 4.
I20260807 13:39:43.539783 22429 raft_consensus.cc:686] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [term 4 LEADER]: Becoming Leader. State: Replica: 3bfc0ccff3be472ba85e284cb351d1bf, State: Running, Role: LEADER
I20260807 13:39:43.540800 22429 consensus_queue.cc:237] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:43.547843 21874 catalog_manager.cc:5495] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf reported cstate change: term changed from 3 to 4, leader changed from 7fa58ef028644655948f04747f2bde86 (127.21.82.66) to 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67). New cstate: current_term: 4 leader_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } health_report { overall_health: HEALTHY } } }
I20260807 13:39:43.612138 22522 raft_consensus.cc:979] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86: : Instructing follower 063fa962cd1747b59eaba0dfdf2dc8c3 to start an election
I20260807 13:39:43.612612 22498 raft_consensus.cc:1067] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [term 1 LEADER]: Signalling peer 063fa962cd1747b59eaba0dfdf2dc8c3 to start an election
I20260807 13:39:43.614041 22014 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7e98d476a5144fa9bf7470cd679bd4bd"
dest_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3"
from {username='slave'} at 127.0.0.1:45576
I20260807 13:39:43.614554 22014 raft_consensus.cc:482] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:39:43.614928 22014 raft_consensus.cc:3037] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:43.619124 22014 raft_consensus.cc:504] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:43.620499 22014 leader_election.cc:288] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 2 election: Requested vote from peers 7fa58ef028644655948f04747f2bde86 (127.21.82.66:46193), 3bfc0ccff3be472ba85e284cb351d1bf (127.21.82.67:38271)
I20260807 13:39:43.621506 22118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e98d476a5144fa9bf7470cd679bd4bd" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7fa58ef028644655948f04747f2bde86"
I20260807 13:39:43.621726 22225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e98d476a5144fa9bf7470cd679bd4bd" candidate_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bfc0ccff3be472ba85e284cb351d1bf"
I20260807 13:39:43.622128 22118 raft_consensus.cc:3032] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:39:43.622236 22225 raft_consensus.cc:3037] T 7e98d476a5144fa9bf7470cd679bd4bd P 3bfc0ccff3be472ba85e284cb351d1bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:43.622501 22118 raft_consensus.cc:729] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7fa58ef028644655948f04747f2bde86, State: Running, Role: LEADER
I20260807 13:39:43.623349 22118 consensus_queue.cc:260] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:43.624667 22118 raft_consensus.cc:3037] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:43.628906 22225 raft_consensus.cc:2454] T 7e98d476a5144fa9bf7470cd679bd4bd P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 063fa962cd1747b59eaba0dfdf2dc8c3 in term 2.
I20260807 13:39:43.629951 21972 leader_election.cc:302] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 063fa962cd1747b59eaba0dfdf2dc8c3, 3bfc0ccff3be472ba85e284cb351d1bf; no voters:
I20260807 13:39:43.630769 22523 raft_consensus.cc:2781] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:39:43.631191 22523 raft_consensus.cc:686] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 LEADER]: Becoming Leader. State: Replica: 063fa962cd1747b59eaba0dfdf2dc8c3, State: Running, Role: LEADER
I20260807 13:39:43.631254 22118 raft_consensus.cc:2454] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 063fa962cd1747b59eaba0dfdf2dc8c3 in term 2.
I20260807 13:39:43.632225 22523 consensus_queue.cc:237] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } }
I20260807 13:39:43.639784 21874 catalog_manager.cc:5495] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3 reported cstate change: term changed from 1 to 2, leader changed from 7fa58ef028644655948f04747f2bde86 (127.21.82.66) to 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65). New cstate: current_term: 2 leader_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:43.863775 22225 raft_consensus.cc:1261] T 587be77f04c94532a0c5cff6fc7c638f P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 FOLLOWER]: Refusing update from remote peer 063fa962cd1747b59eaba0dfdf2dc8c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:39:43.864990 22523 consensus_queue.cc:1035] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:39:43.875876 22118 raft_consensus.cc:1261] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86 [term 3 FOLLOWER]: Refusing update from remote peer 063fa962cd1747b59eaba0dfdf2dc8c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:39:43.878188 22523 consensus_queue.cc:1035] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:39:43.913546 22227 raft_consensus.cc:1261] T 6f765d57daa445ac921adbf4e9cbda89 P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 FOLLOWER]: Refusing update from remote peer 063fa962cd1747b59eaba0dfdf2dc8c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:39:43.913512 22118 raft_consensus.cc:1261] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 4 FOLLOWER]: Refusing update from remote peer 3bfc0ccff3be472ba85e284cb351d1bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 13:39:43.915109 22523 consensus_queue.cc:1035] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:39:43.915091 22429 consensus_queue.cc:1035] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:39:43.925786 22014 raft_consensus.cc:1261] T e18532a632434a23ba646b0c9af99180 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 4 FOLLOWER]: Refusing update from remote peer 3bfc0ccff3be472ba85e284cb351d1bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 13:39:43.927296 22535 consensus_queue.cc:1035] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:39:43.929844 22120 raft_consensus.cc:1261] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [term 3 FOLLOWER]: Refusing update from remote peer 063fa962cd1747b59eaba0dfdf2dc8c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:39:43.931354 22523 consensus_queue.cc:1035] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:39:43.953022 22014 raft_consensus.cc:1261] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 4 FOLLOWER]: Refusing update from remote peer 3bfc0ccff3be472ba85e284cb351d1bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 13:39:43.954191 22429 consensus_queue.cc:1035] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "063fa962cd1747b59eaba0dfdf2dc8c3" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 38001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:39:43.964349 22118 raft_consensus.cc:1261] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [term 4 FOLLOWER]: Refusing update from remote peer 3bfc0ccff3be472ba85e284cb351d1bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 13:39:43.965783 22535 consensus_queue.cc:1035] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:39:44.089303 22118 raft_consensus.cc:1261] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Refusing update from remote peer 063fa962cd1747b59eaba0dfdf2dc8c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:44.090538 22523 consensus_queue.cc:1035] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fa58ef028644655948f04747f2bde86" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:44.094533 22227 raft_consensus.cc:1261] T 7e98d476a5144fa9bf7470cd679bd4bd P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 FOLLOWER]: Refusing update from remote peer 063fa962cd1747b59eaba0dfdf2dc8c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:44.096396 22523 consensus_queue.cc:1035] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfc0ccff3be472ba85e284cb351d1bf" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 38271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:39:44.163448 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:39:44.168443 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:39:44.168915 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:39:45.169747 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:39:45.175046 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:39:45.175424 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:39:46.176159 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:39:46.180953 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:39:46.181509 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:39:47.182315 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:39:47.187515 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:39:47.187995 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:39:48.188959 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:39:48.193856 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:39:48.194279 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:39:49.195149 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:39:49.200825 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:39:49.201220 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:39:50.305608 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:39:50.316538 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:39:50.317020 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260807 13:39:51.299364 22254 debug-util.cc:398] Leaking SignalData structure 0x7b080016b060 after lost signal to thread 21836
W20260807 13:39:51.300328 22254 debug-util.cc:398] Leaking SignalData structure 0x7b080016b740 after lost signal to thread 21922
W20260807 13:39:51.301291 22254 debug-util.cc:398] Leaking SignalData structure 0x7b08001f7b60 after lost signal to thread 22048
W20260807 13:39:51.302378 22254 debug-util.cc:398] Leaking SignalData structure 0x7b08000a3e20 after lost signal to thread 22151
W20260807 13:39:51.303339 22254 debug-util.cc:398] Leaking SignalData structure 0x7b08000f0680 after lost signal to thread 22257
I20260807 13:39:51.319353 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:39:51.329608 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:39:51.330515 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:39:52.331537 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:39:52.337534 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:39:52.338016 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:39:53.377806 21833 auto_leader_rebalancer-test.cc:314] The leader distribution is
I20260807 13:39:53.378495 21833 tablet_server.cc:178] TabletServer@127.21.82.65:0 shutting down...
W20260807 13:39:53.415294 22180 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260807 13:39:53.420198 22180 consensus_peers.cc:487] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf -> Peer 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001): Couldn't send request to peer 063fa962cd1747b59eaba0dfdf2dc8c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:39:53.436173 21833 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260807 13:39:53.437143 21833 tablet_replica.cc:330] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3: stopping tablet replica
I20260807 13:39:53.438350 21833 raft_consensus.cc:2229] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 3 LEADER]: Raft consensus shutting down.
I20260807 13:39:53.439822 21833 raft_consensus.cc:2258] T 6f765d57daa445ac921adbf4e9cbda89 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:53.443565 21833 tablet_replica.cc:330] T e18532a632434a23ba646b0c9af99180 P 063fa962cd1747b59eaba0dfdf2dc8c3: stopping tablet replica
I20260807 13:39:53.444576 21833 raft_consensus.cc:2229] T e18532a632434a23ba646b0c9af99180 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 13:39:53.445392 21833 raft_consensus.cc:2258] T e18532a632434a23ba646b0c9af99180 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:53.448004 21833 tablet_replica.cc:330] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3: stopping tablet replica
I20260807 13:39:53.448745 21833 raft_consensus.cc:2229] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:39:53.449401 21833 raft_consensus.cc:2258] T 192a1c6675714a2f84c6512dcbafdf7f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:53.451951 21833 tablet_replica.cc:330] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3: stopping tablet replica
I20260807 13:39:53.452685 21833 raft_consensus.cc:2229] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 13:39:53.453279 21833 raft_consensus.cc:2258] T 84a2737494bb45768d81f593432c7145 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:53.455874 21833 tablet_replica.cc:330] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3: stopping tablet replica
I20260807 13:39:53.456600 21833 raft_consensus.cc:2229] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:39:53.457186 21833 raft_consensus.cc:2258] T b930bdfd826e4d96b62ab161cae7bd44 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:53.459707 21833 tablet_replica.cc:330] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3: stopping tablet replica
I20260807 13:39:53.460402 21833 raft_consensus.cc:2229] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 13:39:53.461000 21833 raft_consensus.cc:2258] T efede11e063a479a9064465add093ed7 P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:53.463598 21833 tablet_replica.cc:330] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3: stopping tablet replica
I20260807 13:39:53.464321 21833 raft_consensus.cc:2229] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 3 LEADER]: Raft consensus shutting down.
I20260807 13:39:53.465459 21833 raft_consensus.cc:2258] T 587be77f04c94532a0c5cff6fc7c638f P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:53.468102 21833 tablet_replica.cc:330] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3: stopping tablet replica
I20260807 13:39:53.468823 21833 raft_consensus.cc:2229] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 LEADER]: Raft consensus shutting down.
I20260807 13:39:53.469986 21833 raft_consensus.cc:2258] T 7e98d476a5144fa9bf7470cd679bd4bd P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:53.472772 21833 tablet_replica.cc:330] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3: stopping tablet replica
I20260807 13:39:53.473441 21833 raft_consensus.cc:2229] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:39:53.474005 21833 raft_consensus.cc:2258] T e173a6d914a64a95badab506789de0fe P 063fa962cd1747b59eaba0dfdf2dc8c3 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260807 13:39:53.476722 22180 consensus_peers.cc:487] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf -> Peer 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001): Couldn't send request to peer 063fa962cd1747b59eaba0dfdf2dc8c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:39:53.606637 21833 tablet_server.cc:194] TabletServer@127.21.82.65:0 shutdown complete.
I20260807 13:39:53.633279 21833 tablet_server.cc:178] TabletServer@127.21.82.66:0 shutting down...
I20260807 13:39:53.672926 21833 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260807 13:39:53.673782 21833 tablet_replica.cc:330] T 192a1c6675714a2f84c6512dcbafdf7f P 7fa58ef028644655948f04747f2bde86: stopping tablet replica
I20260807 13:39:53.674840 21833 raft_consensus.cc:2229] T 192a1c6675714a2f84c6512dcbafdf7f P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:39:53.675565 21833 raft_consensus.cc:2258] T 192a1c6675714a2f84c6512dcbafdf7f P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:53.678341 21833 tablet_replica.cc:330] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86: stopping tablet replica
I20260807 13:39:53.679172 21833 raft_consensus.cc:2229] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86 [term 3 LEADER]: Raft consensus shutting down.
I20260807 13:39:53.680449 21833 raft_consensus.cc:2258] T e173a6d914a64a95badab506789de0fe P 7fa58ef028644655948f04747f2bde86 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:53.683257 21833 tablet_replica.cc:330] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86: stopping tablet replica
I20260807 13:39:53.684103 21833 raft_consensus.cc:2229] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:39:53.684681 21833 raft_consensus.cc:2258] T 7e98d476a5144fa9bf7470cd679bd4bd P 7fa58ef028644655948f04747f2bde86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:53.687305 21833 tablet_replica.cc:330] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86: stopping tablet replica
I20260807 13:39:53.688184 21833 raft_consensus.cc:2229] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 [term 3 LEADER]: Raft consensus shutting down.
I20260807 13:39:53.689432 21833 raft_consensus.cc:2258] T b930bdfd826e4d96b62ab161cae7bd44 P 7fa58ef028644655948f04747f2bde86 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:53.691854 21833 tablet_replica.cc:330] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86: stopping tablet replica
I20260807 13:39:53.692366 21833 raft_consensus.cc:2229] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 13:39:53.692811 21833 raft_consensus.cc:2258] T 84a2737494bb45768d81f593432c7145 P 7fa58ef028644655948f04747f2bde86 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:53.694762 21833 tablet_replica.cc:330] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86: stopping tablet replica
I20260807 13:39:53.695288 21833 raft_consensus.cc:2229] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:39:53.695834 21833 raft_consensus.cc:2258] T 6f765d57daa445ac921adbf4e9cbda89 P 7fa58ef028644655948f04747f2bde86 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:53.697757 21833 tablet_replica.cc:330] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86: stopping tablet replica
I20260807 13:39:53.698328 21833 raft_consensus.cc:2229] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 13:39:53.698837 21833 raft_consensus.cc:2258] T e18532a632434a23ba646b0c9af99180 P 7fa58ef028644655948f04747f2bde86 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:53.700673 21833 tablet_replica.cc:330] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86: stopping tablet replica
I20260807 13:39:53.701201 21833 raft_consensus.cc:2229] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:39:53.701694 21833 raft_consensus.cc:2258] T 587be77f04c94532a0c5cff6fc7c638f P 7fa58ef028644655948f04747f2bde86 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:53.703603 21833 tablet_replica.cc:330] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86: stopping tablet replica
I20260807 13:39:53.704079 21833 raft_consensus.cc:2229] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [term 4 LEADER]: Raft consensus shutting down.
I20260807 13:39:53.704952 21833 raft_consensus.cc:2258] T efede11e063a479a9064465add093ed7 P 7fa58ef028644655948f04747f2bde86 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:53.735047 21833 tablet_server.cc:194] TabletServer@127.21.82.66:0 shutdown complete.
W20260807 13:39:53.756233 22180 consensus_peers.cc:487] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf -> Peer 063fa962cd1747b59eaba0dfdf2dc8c3 (127.21.82.65:38001): Couldn't send request to peer 063fa962cd1747b59eaba0dfdf2dc8c3. Status: Network error: Client connection negotiation failed: client connection to 127.21.82.65:38001: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:39:53.756912 21833 tablet_server.cc:178] TabletServer@127.21.82.67:0 shutting down...
I20260807 13:39:53.785135 21833 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260807 13:39:53.785796 21833 tablet_replica.cc:330] T 7e98d476a5144fa9bf7470cd679bd4bd P 3bfc0ccff3be472ba85e284cb351d1bf: stopping tablet replica
I20260807 13:39:53.786449 21833 raft_consensus.cc:2229] T 7e98d476a5144fa9bf7470cd679bd4bd P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:39:53.787009 21833 raft_consensus.cc:2258] T 7e98d476a5144fa9bf7470cd679bd4bd P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:53.789088 21833 tablet_replica.cc:330] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf: stopping tablet replica
I20260807 13:39:53.789602 21833 raft_consensus.cc:2229] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:39:53.790036 21833 raft_consensus.cc:2258] T e173a6d914a64a95badab506789de0fe P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:53.791838 21833 tablet_replica.cc:330] T 6f765d57daa445ac921adbf4e9cbda89 P 3bfc0ccff3be472ba85e284cb351d1bf: stopping tablet replica
I20260807 13:39:53.792331 21833 raft_consensus.cc:2229] T 6f765d57daa445ac921adbf4e9cbda89 P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:39:53.792784 21833 raft_consensus.cc:2258] T 6f765d57daa445ac921adbf4e9cbda89 P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:53.794432 21833 tablet_replica.cc:330] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf: stopping tablet replica
I20260807 13:39:53.794950 21833 raft_consensus.cc:2229] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [term 4 LEADER]: Raft consensus shutting down.
I20260807 13:39:53.795768 21833 raft_consensus.cc:2258] T e18532a632434a23ba646b0c9af99180 P 3bfc0ccff3be472ba85e284cb351d1bf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:53.797362 21833 tablet_replica.cc:330] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf: stopping tablet replica
I20260807 13:39:53.797891 21833 raft_consensus.cc:2229] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [term 4 LEADER]: Raft consensus shutting down.
I20260807 13:39:53.798761 21833 raft_consensus.cc:2258] T 84a2737494bb45768d81f593432c7145 P 3bfc0ccff3be472ba85e284cb351d1bf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:53.800523 21833 tablet_replica.cc:330] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf: stopping tablet replica
I20260807 13:39:53.801033 21833 raft_consensus.cc:2229] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:39:53.801481 21833 raft_consensus.cc:2258] T b930bdfd826e4d96b62ab161cae7bd44 P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:53.803151 21833 tablet_replica.cc:330] T 587be77f04c94532a0c5cff6fc7c638f P 3bfc0ccff3be472ba85e284cb351d1bf: stopping tablet replica
I20260807 13:39:53.803628 21833 raft_consensus.cc:2229] T 587be77f04c94532a0c5cff6fc7c638f P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:39:53.804064 21833 raft_consensus.cc:2258] T 587be77f04c94532a0c5cff6fc7c638f P 3bfc0ccff3be472ba85e284cb351d1bf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:53.805598 21833 tablet_replica.cc:330] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf: stopping tablet replica
I20260807 13:39:53.806037 21833 raft_consensus.cc:2229] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 13:39:53.806455 21833 raft_consensus.cc:2258] T efede11e063a479a9064465add093ed7 P 3bfc0ccff3be472ba85e284cb351d1bf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:53.808038 21833 tablet_replica.cc:330] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf: stopping tablet replica
I20260807 13:39:53.808444 21833 raft_consensus.cc:2229] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 LEADER]: Raft consensus shutting down.
I20260807 13:39:53.809257 21833 raft_consensus.cc:2258] T 192a1c6675714a2f84c6512dcbafdf7f P 3bfc0ccff3be472ba85e284cb351d1bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:53.853641 21833 tablet_server.cc:194] TabletServer@127.21.82.67:0 shutdown complete.
I20260807 13:39:53.873402 21833 master.cc:537] Master@127.21.82.126:36399 shutting down...
I20260807 13:39:54.159065 21833 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 9a3ca23083684ea5b9c2d45167478623 [term 1 LEADER]: Raft consensus shutting down.
I20260807 13:39:54.159686 21833 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 9a3ca23083684ea5b9c2d45167478623 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:54.160033 21833 tablet_replica.cc:330] T 00000000000000000000000000000000 P 9a3ca23083684ea5b9c2d45167478623: stopping tablet replica
I20260807 13:39:54.179760 21833 master.cc:552] Master@127.21.82.126:36399 shutdown complete.
063fa962cd1747b59eaba0dfdf2dc8c3 4
3bfc0ccff3be472ba85e284cb351d1bf 1
7fa58ef028644655948f04747f2bde86 4
063fa962cd1747b59eaba0dfdf2dc8c3 3
3bfc0ccff3be472ba85e284cb351d1bf 3
7fa58ef028644655948f04747f2bde86 3
063fa962cd1747b59eaba0dfdf2dc8c3 0
3bfc0ccff3be472ba85e284cb351d1bf 1
7fa58ef028644655948f04747f2bde86 8
063fa962cd1747b59eaba0dfdf2dc8c3 3
3bfc0ccff3be472ba85e284cb351d1bf 3
7fa58ef028644655948f04747f2bde86 3
[ OK ] LeaderRebalancerTest.FunctionalTestForDivided (33706 ms)
[ RUN ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260807 13:39:54.226432 21833 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.21.82.126:38765
I20260807 13:39:54.227643 21833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:39:54.233929 22596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:39:54.234136 22597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:39:54.235287 22601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:39:54.236719 21833 server_base.cc:1034] running on GCE node
I20260807 13:39:54.238237 21833 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:39:54.238555 21833 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:39:54.239223 21833 hybrid_clock.cc:648] HybridClock initialized: now 1786109994239204 us; error 0 us; skew 500 ppm
I20260807 13:39:54.239835 21833 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:39:54.246773 21833 webserver.cc:460] Webserver started at http://127.21.82.126:36315/ using document root <none> and password file <none>
I20260807 13:39:54.247368 21833 fs_manager.cc:359] Metadata directory not provided
I20260807 13:39:54.247582 21833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:39:54.247936 21833 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:39:54.249251 21833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109960278411-21833-0/minicluster-data/master-0-root/instance:
uuid: "f92780d5985648c392d9a47e02c93b51"
format_stamp: "Formatted at 2026-08-07 13:39:54 on dist-test-slave-3kk6"
I20260807 13:39:54.254347 21833 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260807 13:39:54.258028 22612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:39:54.258908 21833 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 13:39:54.259223 21833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109960278411-21833-0/minicluster-data/master-0-root
uuid: "f92780d5985648c392d9a47e02c93b51"
format_stamp: "Formatted at 2026-08-07 13:39:54 on dist-test-slave-3kk6"
I20260807 13:39:54.259536 21833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109960278411-21833-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109960278411-21833-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109960278411-21833-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:39:54.331115 21833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:39:54.332619 21833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:39:54.379038 21833 rpc_server.cc:307] RPC server started. Bound to: 127.21.82.126:38765
I20260807 13:39:54.379130 22685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.82.126:38765 every 8 connection(s)
I20260807 13:39:54.383177 22686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:54.393523 22686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f92780d5985648c392d9a47e02c93b51: Bootstrap starting.
I20260807 13:39:54.398499 22686 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f92780d5985648c392d9a47e02c93b51: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:54.403178 22686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f92780d5985648c392d9a47e02c93b51: No bootstrap required, opened a new log
I20260807 13:39:54.405337 22686 raft_consensus.cc:348] T 00000000000000000000000000000000 P f92780d5985648c392d9a47e02c93b51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f92780d5985648c392d9a47e02c93b51" member_type: VOTER }
I20260807 13:39:54.405885 22686 raft_consensus.cc:374] T 00000000000000000000000000000000 P f92780d5985648c392d9a47e02c93b51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:54.406133 22686 raft_consensus.cc:729] T 00000000000000000000000000000000 P f92780d5985648c392d9a47e02c93b51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f92780d5985648c392d9a47e02c93b51, State: Initialized, Role: FOLLOWER
I20260807 13:39:54.406847 22686 consensus_queue.cc:260] T 00000000000000000000000000000000 P f92780d5985648c392d9a47e02c93b51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f92780d5985648c392d9a47e02c93b51" member_type: VOTER }
I20260807 13:39:54.407397 22686 raft_consensus.cc:388] T 00000000000000000000000000000000 P f92780d5985648c392d9a47e02c93b51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 13:39:54.407680 22686 raft_consensus.cc:482] T 00000000000000000000000000000000 P f92780d5985648c392d9a47e02c93b51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 13:39:54.407995 22686 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f92780d5985648c392d9a47e02c93b51 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:54.412317 22686 raft_consensus.cc:504] T 00000000000000000000000000000000 P f92780d5985648c392d9a47e02c93b51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f92780d5985648c392d9a47e02c93b51" member_type: VOTER }
I20260807 13:39:54.412979 22686 leader_election.cc:302] T 00000000000000000000000000000000 P f92780d5985648c392d9a47e02c93b51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f92780d5985648c392d9a47e02c93b51; no voters:
I20260807 13:39:54.414327 22686 leader_election.cc:288] T 00000000000000000000000000000000 P f92780d5985648c392d9a47e02c93b51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 13:39:54.414875 22690 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f92780d5985648c392d9a47e02c93b51 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:39:54.416349 22690 raft_consensus.cc:686] T 00000000000000000000000000000000 P f92780d5985648c392d9a47e02c93b51 [term 1 LEADER]: Becoming Leader. State: Replica: f92780d5985648c392d9a47e02c93b51, State: Running, Role: LEADER
I20260807 13:39:54.417142 22690 consensus_queue.cc:237] T 00000000000000000000000000000000 P f92780d5985648c392d9a47e02c93b51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f92780d5985648c392d9a47e02c93b51" member_type: VOTER }
I20260807 13:39:54.418016 22686 sys_catalog.cc:564] T 00000000000000000000000000000000 P f92780d5985648c392d9a47e02c93b51 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 13:39:54.423849 22695 sys_catalog.cc:455] T 00000000000000000000000000000000 P f92780d5985648c392d9a47e02c93b51 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f92780d5985648c392d9a47e02c93b51. Latest consensus state: current_term: 1 leader_uuid: "f92780d5985648c392d9a47e02c93b51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f92780d5985648c392d9a47e02c93b51" member_type: VOTER } }
I20260807 13:39:54.424679 22695 sys_catalog.cc:458] T 00000000000000000000000000000000 P f92780d5985648c392d9a47e02c93b51 [sys.catalog]: This master's current role is: LEADER
I20260807 13:39:54.425134 22693 sys_catalog.cc:455] T 00000000000000000000000000000000 P f92780d5985648c392d9a47e02c93b51 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f92780d5985648c392d9a47e02c93b51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f92780d5985648c392d9a47e02c93b51" member_type: VOTER } }
I20260807 13:39:54.425904 22693 sys_catalog.cc:458] T 00000000000000000000000000000000 P f92780d5985648c392d9a47e02c93b51 [sys.catalog]: This master's current role is: LEADER
I20260807 13:39:54.426918 22705 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 13:39:54.432154 22705 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 13:39:54.434552 21833 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260807 13:39:54.442101 22705 catalog_manager.cc:1347] Generated new cluster ID: 1c525324f4d84cbfbe9e980d2149fecf
I20260807 13:39:54.442471 22705 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 13:39:54.474004 22705 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 13:39:54.475817 22705 catalog_manager.cc:1504] Loading token signing keys...
I20260807 13:39:54.491474 22705 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f92780d5985648c392d9a47e02c93b51: Generated new TSK 0
I20260807 13:39:54.492199 22705 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 13:39:54.501430 21833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:39:54.508656 22723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:39:54.510414 22724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:39:54.511605 22726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:39:54.512717 21833 server_base.cc:1034] running on GCE node
I20260807 13:39:54.513702 21833 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:39:54.513890 21833 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:39:54.514003 21833 hybrid_clock.cc:648] HybridClock initialized: now 1786109994513994 us; error 0 us; skew 500 ppm
I20260807 13:39:54.514472 21833 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:39:54.517115 21833 webserver.cc:460] Webserver started at http://127.21.82.65:38029/ using document root <none> and password file <none>
I20260807 13:39:54.517611 21833 fs_manager.cc:359] Metadata directory not provided
I20260807 13:39:54.517771 21833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:39:54.517987 21833 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:39:54.519490 21833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109960278411-21833-0/minicluster-data/ts-0-root/instance:
uuid: "ce1db935895842f49ccbd894ab313d5c"
format_stamp: "Formatted at 2026-08-07 13:39:54 on dist-test-slave-3kk6"
I20260807 13:39:54.524555 21833 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 13:39:54.528263 22731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:39:54.529054 21833 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.004s sys 0.000s
I20260807 13:39:54.529493 21833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109960278411-21833-0/minicluster-data/ts-0-root
uuid: "ce1db935895842f49ccbd894ab313d5c"
format_stamp: "Formatted at 2026-08-07 13:39:54 on dist-test-slave-3kk6"
I20260807 13:39:54.529809 21833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109960278411-21833-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109960278411-21833-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109960278411-21833-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:39:54.541543 21833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:39:54.543568 21833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:39:54.545475 21833 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 13:39:54.548494 21833 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:39:54.548700 21833 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:39:54.549008 21833 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 13:39:54.549201 21833 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:39:54.598592 21833 rpc_server.cc:307] RPC server started. Bound to: 127.21.82.65:40693
I20260807 13:39:54.598819 22818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.82.65:40693 every 8 connection(s)
I20260807 13:39:54.603618 21833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:39:54.613164 22825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:39:54.614253 22824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:39:54.615091 22827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:39:54.617494 21833 server_base.cc:1034] running on GCE node
I20260807 13:39:54.619431 21833 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:39:54.619669 21833 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:39:54.619974 21833 hybrid_clock.cc:648] HybridClock initialized: now 1786109994619957 us; error 0 us; skew 500 ppm
I20260807 13:39:54.620677 21833 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:39:54.621420 22819 heartbeater.cc:347] Connected to a master server at 127.21.82.126:38765
I20260807 13:39:54.621846 22819 heartbeater.cc:464] Registering TS with master...
I20260807 13:39:54.622887 22819 heartbeater.cc:511] Master 127.21.82.126:38765 requested a full tablet report, sending...
I20260807 13:39:54.623768 21833 webserver.cc:460] Webserver started at http://127.21.82.66:41239/ using document root <none> and password file <none>
I20260807 13:39:54.624468 21833 fs_manager.cc:359] Metadata directory not provided
I20260807 13:39:54.624727 21833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:39:54.625068 21833 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:39:54.625396 22638 ts_manager.cc:194] Registered new tserver with Master: ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693)
I20260807 13:39:54.626425 21833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109960278411-21833-0/minicluster-data/ts-1-root/instance:
uuid: "cc4e4942424c4427931538dabfc6b63d"
format_stamp: "Formatted at 2026-08-07 13:39:54 on dist-test-slave-3kk6"
I20260807 13:39:54.627561 22638 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40716
I20260807 13:39:54.633090 21833 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 13:39:54.636796 22833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:39:54.637739 21833 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 13:39:54.638005 21833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109960278411-21833-0/minicluster-data/ts-1-root
uuid: "cc4e4942424c4427931538dabfc6b63d"
format_stamp: "Formatted at 2026-08-07 13:39:54 on dist-test-slave-3kk6"
I20260807 13:39:54.638260 21833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109960278411-21833-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109960278411-21833-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109960278411-21833-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:39:54.672358 21833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:39:54.673712 21833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:39:54.675294 21833 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 13:39:54.677726 21833 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:39:54.677920 21833 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:39:54.678221 21833 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 13:39:54.678385 21833 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:39:54.723605 21833 rpc_server.cc:307] RPC server started. Bound to: 127.21.82.66:46489
I20260807 13:39:54.723722 22920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.82.66:46489 every 8 connection(s)
I20260807 13:39:54.728520 21833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:39:54.736862 22924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:39:54.738099 22925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:39:54.741380 21833 server_base.cc:1034] running on GCE node
W20260807 13:39:54.742590 22929 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:39:54.743789 21833 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:39:54.744109 21833 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:39:54.744397 21833 hybrid_clock.cc:648] HybridClock initialized: now 1786109994744370 us; error 0 us; skew 500 ppm
I20260807 13:39:54.744951 21833 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:39:54.745360 22921 heartbeater.cc:347] Connected to a master server at 127.21.82.126:38765
I20260807 13:39:54.745774 22921 heartbeater.cc:464] Registering TS with master...
I20260807 13:39:54.746798 22921 heartbeater.cc:511] Master 127.21.82.126:38765 requested a full tablet report, sending...
I20260807 13:39:54.748206 21833 webserver.cc:460] Webserver started at http://127.21.82.67:32837/ using document root <none> and password file <none>
I20260807 13:39:54.748895 21833 fs_manager.cc:359] Metadata directory not provided
I20260807 13:39:54.749140 21833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:39:54.749202 22638 ts_manager.cc:194] Registered new tserver with Master: cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489)
I20260807 13:39:54.749516 21833 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:39:54.751152 21833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109960278411-21833-0/minicluster-data/ts-2-root/instance:
uuid: "d356524433a542328c096746bed5abef"
format_stamp: "Formatted at 2026-08-07 13:39:54 on dist-test-slave-3kk6"
I20260807 13:39:54.751459 22638 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40732
I20260807 13:39:54.756911 21833 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 13:39:54.760783 22936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:39:54.761710 21833 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 13:39:54.762002 21833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109960278411-21833-0/minicluster-data/ts-2-root
uuid: "d356524433a542328c096746bed5abef"
format_stamp: "Formatted at 2026-08-07 13:39:54 on dist-test-slave-3kk6"
I20260807 13:39:54.762307 21833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109960278411-21833-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109960278411-21833-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109960278411-21833-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:39:54.779824 21833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:39:54.781242 21833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:39:54.783011 21833 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 13:39:54.785501 21833 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:39:54.785740 21833 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:39:54.785990 21833 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 13:39:54.786159 21833 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:39:54.838124 21833 rpc_server.cc:307] RPC server started. Bound to: 127.21.82.67:36453
I20260807 13:39:54.838266 23034 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.82.67:36453 every 8 connection(s)
I20260807 13:39:54.854931 23035 heartbeater.cc:347] Connected to a master server at 127.21.82.126:38765
I20260807 13:39:54.855309 23035 heartbeater.cc:464] Registering TS with master...
I20260807 13:39:54.856020 23035 heartbeater.cc:511] Master 127.21.82.126:38765 requested a full tablet report, sending...
I20260807 13:39:54.858024 22638 ts_manager.cc:194] Registered new tserver with Master: d356524433a542328c096746bed5abef (127.21.82.67:36453)
I20260807 13:39:54.859119 21833 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017203059s
I20260807 13:39:54.860062 22638 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40740
I20260807 13:39:54.862350 21833 test_util.cc:268] Using random seed: 600180462
I20260807 13:39:54.888366 22638 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40750:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 13:39:54.891561 22638 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 13:39:54.975277 22977 tablet_service.cc:1467] Processing CreateTablet for tablet 124b47385de445e08109ad645d366881 (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260807 13:39:54.975865 22976 tablet_service.cc:1467] Processing CreateTablet for tablet 507d17016e0d4daaa005e6cef4e44bbe (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260807 13:39:54.977032 22977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 124b47385de445e08109ad645d366881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:54.978776 22976 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 507d17016e0d4daaa005e6cef4e44bbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:54.979034 22970 tablet_service.cc:1467] Processing CreateTablet for tablet d10115b832134c989a9752a1626893e6 (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260807 13:39:54.979451 22980 tablet_service.cc:1467] Processing CreateTablet for tablet e234587595554ae183f5b9604ba1c0b9 (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260807 13:39:54.980592 22970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d10115b832134c989a9752a1626893e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:54.978821 22974 tablet_service.cc:1467] Processing CreateTablet for tablet c9bbe03a111e4a43a9bc12b726d2748e (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260807 13:39:54.982183 22974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9bbe03a111e4a43a9bc12b726d2748e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:54.983078 22980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e234587595554ae183f5b9604ba1c0b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:54.984201 22967 tablet_service.cc:1467] Processing CreateTablet for tablet a635ded89e9c481bbd9d31bcd04ed678 (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260807 13:39:54.985680 22967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a635ded89e9c481bbd9d31bcd04ed678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:54.988099 22966 tablet_service.cc:1467] Processing CreateTablet for tablet a5872d5bc74e4657867e0d2cafb86ad6 (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260807 13:39:54.989504 22966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5872d5bc74e4657867e0d2cafb86ad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:54.991633 22979 tablet_service.cc:1467] Processing CreateTablet for tablet b81bed43b6aa4d64953c7bd3b5f10d3c (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260807 13:39:54.993108 22979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b81bed43b6aa4d64953c7bd3b5f10d3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:54.998493 22965 tablet_service.cc:1467] Processing CreateTablet for tablet 69f0e9ea6b784ea89a5cb1fcc5a0293e (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260807 13:39:55.001266 22869 tablet_service.cc:1467] Processing CreateTablet for tablet b81bed43b6aa4d64953c7bd3b5f10d3c (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260807 13:39:55.004621 22868 tablet_service.cc:1467] Processing CreateTablet for tablet 124b47385de445e08109ad645d366881 (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260807 13:39:55.006631 22868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 124b47385de445e08109ad645d366881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:55.008467 22865 tablet_service.cc:1467] Processing CreateTablet for tablet c9bbe03a111e4a43a9bc12b726d2748e (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260807 13:39:55.010195 22867 tablet_service.cc:1467] Processing CreateTablet for tablet 507d17016e0d4daaa005e6cef4e44bbe (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260807 13:39:55.012140 22864 tablet_service.cc:1467] Processing CreateTablet for tablet d10115b832134c989a9752a1626893e6 (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260807 13:39:55.012832 22965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69f0e9ea6b784ea89a5cb1fcc5a0293e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:55.013805 22870 tablet_service.cc:1467] Processing CreateTablet for tablet e234587595554ae183f5b9604ba1c0b9 (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260807 13:39:55.016392 22863 tablet_service.cc:1467] Processing CreateTablet for tablet a635ded89e9c481bbd9d31bcd04ed678 (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260807 13:39:55.012444 22964 tablet_service.cc:1467] Processing CreateTablet for tablet 723969ccd114427893218ff642633ff4 (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260807 13:39:55.024340 22859 tablet_service.cc:1467] Processing CreateTablet for tablet a5872d5bc74e4657867e0d2cafb86ad6 (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260807 13:39:55.036811 22964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 723969ccd114427893218ff642633ff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:55.029369 22865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9bbe03a111e4a43a9bc12b726d2748e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:55.038031 22869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b81bed43b6aa4d64953c7bd3b5f10d3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:55.038960 22867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 507d17016e0d4daaa005e6cef4e44bbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:55.043009 22863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a635ded89e9c481bbd9d31bcd04ed678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:55.044535 22858 tablet_service.cc:1467] Processing CreateTablet for tablet 69f0e9ea6b784ea89a5cb1fcc5a0293e (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260807 13:39:55.045104 22870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e234587595554ae183f5b9604ba1c0b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:55.046092 22858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69f0e9ea6b784ea89a5cb1fcc5a0293e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:55.048499 22859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5872d5bc74e4657867e0d2cafb86ad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:55.048239 22857 tablet_service.cc:1467] Processing CreateTablet for tablet 723969ccd114427893218ff642633ff4 (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260807 13:39:55.054059 22864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d10115b832134c989a9752a1626893e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:55.059170 22857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 723969ccd114427893218ff642633ff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:55.123520 23055 tablet_bootstrap.cc:492] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef: Bootstrap starting.
I20260807 13:39:55.128778 23055 tablet_bootstrap.cc:654] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:55.138027 23056 tablet_bootstrap.cc:492] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d: Bootstrap starting.
I20260807 13:39:55.143188 22767 tablet_service.cc:1467] Processing CreateTablet for tablet 507d17016e0d4daaa005e6cef4e44bbe (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260807 13:39:55.143919 22770 tablet_service.cc:1467] Processing CreateTablet for tablet b81bed43b6aa4d64953c7bd3b5f10d3c (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260807 13:39:55.144658 22767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 507d17016e0d4daaa005e6cef4e44bbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:55.145269 22770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b81bed43b6aa4d64953c7bd3b5f10d3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:55.148002 22764 tablet_service.cc:1467] Processing CreateTablet for tablet c9bbe03a111e4a43a9bc12b726d2748e (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260807 13:39:55.149585 22764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9bbe03a111e4a43a9bc12b726d2748e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:55.149374 22762 tablet_service.cc:1467] Processing CreateTablet for tablet d10115b832134c989a9752a1626893e6 (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260807 13:39:55.152104 22760 tablet_service.cc:1467] Processing CreateTablet for tablet a635ded89e9c481bbd9d31bcd04ed678 (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260807 13:39:55.153487 22760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a635ded89e9c481bbd9d31bcd04ed678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:55.147997 22768 tablet_service.cc:1467] Processing CreateTablet for tablet 124b47385de445e08109ad645d366881 (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260807 13:39:55.150102 22757 tablet_service.cc:1467] Processing CreateTablet for tablet 723969ccd114427893218ff642633ff4 (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260807 13:39:55.154604 22768 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 124b47385de445e08109ad645d366881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:55.142078 22771 tablet_service.cc:1467] Processing CreateTablet for tablet e234587595554ae183f5b9604ba1c0b9 (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260807 13:39:55.155864 22771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e234587595554ae183f5b9604ba1c0b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:55.157238 22758 tablet_service.cc:1467] Processing CreateTablet for tablet 69f0e9ea6b784ea89a5cb1fcc5a0293e (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260807 13:39:55.158641 22758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69f0e9ea6b784ea89a5cb1fcc5a0293e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:55.161911 22757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 723969ccd114427893218ff642633ff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:55.160152 22759 tablet_service.cc:1467] Processing CreateTablet for tablet a5872d5bc74e4657867e0d2cafb86ad6 (DEFAULT_TABLE table=test-workload [id=779e799ec32a44208622688f2634c65e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260807 13:39:55.164497 22759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5872d5bc74e4657867e0d2cafb86ad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:55.174063 22762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d10115b832134c989a9752a1626893e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:55.187645 23058 tablet_bootstrap.cc:492] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c: Bootstrap starting.
I20260807 13:39:55.189551 23055 tablet_bootstrap.cc:492] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef: No bootstrap required, opened a new log
I20260807 13:39:55.203701 23058 tablet_bootstrap.cc:654] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:55.203812 23055 ts_tablet_manager.cc:1397] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef: Time spent bootstrapping tablet: real 0.081s user 0.009s sys 0.010s
I20260807 13:39:55.209254 23056 tablet_bootstrap.cc:654] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:55.211503 23055 raft_consensus.cc:348] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.213096 23055 raft_consensus.cc:374] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:55.213413 23055 raft_consensus.cc:729] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d356524433a542328c096746bed5abef, State: Initialized, Role: FOLLOWER
I20260807 13:39:55.214237 23055 consensus_queue.cc:260] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.214903 23058 tablet_bootstrap.cc:492] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c: No bootstrap required, opened a new log
I20260807 13:39:55.215353 23058 ts_tablet_manager.cc:1397] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c: Time spent bootstrapping tablet: real 0.028s user 0.009s sys 0.004s
I20260807 13:39:55.219177 23058 raft_consensus.cc:348] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.220149 23058 raft_consensus.cc:374] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:55.220522 23058 raft_consensus.cc:729] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Initialized, Role: FOLLOWER
I20260807 13:39:55.221436 23058 consensus_queue.cc:260] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.244626 23035 heartbeater.cc:503] Master 127.21.82.126:38765 was elected leader, sending a full tablet report...
I20260807 13:39:55.245221 23055 ts_tablet_manager.cc:1428] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef: Time spent starting tablet: real 0.037s user 0.011s sys 0.023s
I20260807 13:39:55.245261 23056 tablet_bootstrap.cc:492] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d: No bootstrap required, opened a new log
I20260807 13:39:55.246280 23056 ts_tablet_manager.cc:1397] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d: Time spent bootstrapping tablet: real 0.109s user 0.007s sys 0.033s
I20260807 13:39:55.246562 23055 tablet_bootstrap.cc:492] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef: Bootstrap starting.
I20260807 13:39:55.250113 23056 raft_consensus.cc:348] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.251332 23056 raft_consensus.cc:374] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:55.251796 23056 raft_consensus.cc:729] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc4e4942424c4427931538dabfc6b63d, State: Initialized, Role: FOLLOWER
I20260807 13:39:55.253368 23055 tablet_bootstrap.cc:654] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:55.252947 23056 consensus_queue.cc:260] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.263062 22819 heartbeater.cc:503] Master 127.21.82.126:38765 was elected leader, sending a full tablet report...
I20260807 13:39:55.263324 23056 ts_tablet_manager.cc:1428] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d: Time spent starting tablet: real 0.016s user 0.004s sys 0.010s
I20260807 13:39:55.264132 22921 heartbeater.cc:503] Master 127.21.82.126:38765 was elected leader, sending a full tablet report...
I20260807 13:39:55.267046 23055 tablet_bootstrap.cc:492] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef: No bootstrap required, opened a new log
I20260807 13:39:55.267714 23055 ts_tablet_manager.cc:1397] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef: Time spent bootstrapping tablet: real 0.021s user 0.010s sys 0.008s
I20260807 13:39:55.270779 23055 raft_consensus.cc:348] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.271795 23055 raft_consensus.cc:374] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:55.272135 23055 raft_consensus.cc:729] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d356524433a542328c096746bed5abef, State: Initialized, Role: FOLLOWER
I20260807 13:39:55.272483 23056 tablet_bootstrap.cc:492] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d: Bootstrap starting.
I20260807 13:39:55.273042 23055 consensus_queue.cc:260] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.275214 23055 ts_tablet_manager.cc:1428] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 13:39:55.275990 23055 tablet_bootstrap.cc:492] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef: Bootstrap starting.
I20260807 13:39:55.278038 23058 ts_tablet_manager.cc:1428] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c: Time spent starting tablet: real 0.062s user 0.018s sys 0.025s
I20260807 13:39:55.281253 23056 tablet_bootstrap.cc:654] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:55.281383 23055 tablet_bootstrap.cc:654] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:55.282744 23058 tablet_bootstrap.cc:492] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c: Bootstrap starting.
I20260807 13:39:55.291332 23058 tablet_bootstrap.cc:654] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:55.318239 23058 tablet_bootstrap.cc:492] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c: No bootstrap required, opened a new log
I20260807 13:39:55.318886 23058 ts_tablet_manager.cc:1397] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c: Time spent bootstrapping tablet: real 0.039s user 0.022s sys 0.012s
I20260807 13:39:55.320612 23056 tablet_bootstrap.cc:492] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d: No bootstrap required, opened a new log
I20260807 13:39:55.321086 23056 ts_tablet_manager.cc:1397] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d: Time spent bootstrapping tablet: real 0.049s user 0.026s sys 0.012s
I20260807 13:39:55.321720 23058 raft_consensus.cc:348] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.322566 23058 raft_consensus.cc:374] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:55.318248 23055 tablet_bootstrap.cc:492] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef: No bootstrap required, opened a new log
I20260807 13:39:55.322928 23058 raft_consensus.cc:729] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Initialized, Role: FOLLOWER
I20260807 13:39:55.323287 23055 ts_tablet_manager.cc:1397] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef: Time spent bootstrapping tablet: real 0.047s user 0.002s sys 0.037s
I20260807 13:39:55.323855 23056 raft_consensus.cc:348] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.323701 23058 consensus_queue.cc:260] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.324584 23056 raft_consensus.cc:374] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:55.324903 23056 raft_consensus.cc:729] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc4e4942424c4427931538dabfc6b63d, State: Initialized, Role: FOLLOWER
I20260807 13:39:55.325690 23055 raft_consensus.cc:348] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } }
I20260807 13:39:55.325610 23056 consensus_queue.cc:260] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.326295 23055 raft_consensus.cc:374] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:55.328033 23058 ts_tablet_manager.cc:1428] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c: Time spent starting tablet: real 0.009s user 0.002s sys 0.004s
I20260807 13:39:55.328658 23055 raft_consensus.cc:729] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d356524433a542328c096746bed5abef, State: Initialized, Role: FOLLOWER
I20260807 13:39:55.329380 23058 tablet_bootstrap.cc:492] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c: Bootstrap starting.
I20260807 13:39:55.329442 23055 consensus_queue.cc:260] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } }
I20260807 13:39:55.332160 23055 ts_tablet_manager.cc:1428] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef: Time spent starting tablet: real 0.009s user 0.002s sys 0.004s
I20260807 13:39:55.333125 23055 tablet_bootstrap.cc:492] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef: Bootstrap starting.
I20260807 13:39:55.335896 23058 tablet_bootstrap.cc:654] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:55.328054 23056 ts_tablet_manager.cc:1428] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260807 13:39:55.339138 23056 tablet_bootstrap.cc:492] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d: Bootstrap starting.
I20260807 13:39:55.339486 23055 tablet_bootstrap.cc:654] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef: Neither blocks nor log segments found. Creating new log.
W20260807 13:39:55.342931 23036 tablet.cc:2369] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 13:39:55.344990 23056 tablet_bootstrap.cc:654] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:55.348074 23055 tablet_bootstrap.cc:492] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef: No bootstrap required, opened a new log
I20260807 13:39:55.348482 23058 tablet_bootstrap.cc:492] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c: No bootstrap required, opened a new log
I20260807 13:39:55.348747 23055 ts_tablet_manager.cc:1397] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.005s
I20260807 13:39:55.348932 23058 ts_tablet_manager.cc:1397] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c: Time spent bootstrapping tablet: real 0.020s user 0.009s sys 0.001s
I20260807 13:39:55.351773 23058 raft_consensus.cc:348] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } }
I20260807 13:39:55.351915 23055 raft_consensus.cc:348] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.352608 23058 raft_consensus.cc:374] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:55.352761 23055 raft_consensus.cc:374] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:55.352964 23058 raft_consensus.cc:729] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Initialized, Role: FOLLOWER
I20260807 13:39:55.353711 23058 consensus_queue.cc:260] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } }
I20260807 13:39:55.354365 23055 raft_consensus.cc:729] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d356524433a542328c096746bed5abef, State: Initialized, Role: FOLLOWER
I20260807 13:39:55.355386 23055 consensus_queue.cc:260] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.356209 23058 ts_tablet_manager.cc:1428] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260807 13:39:55.358004 23055 ts_tablet_manager.cc:1428] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260807 13:39:55.359398 23055 tablet_bootstrap.cc:492] T 124b47385de445e08109ad645d366881 P d356524433a542328c096746bed5abef: Bootstrap starting.
I20260807 13:39:55.360163 23056 tablet_bootstrap.cc:492] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d: No bootstrap required, opened a new log
I20260807 13:39:55.360688 23056 ts_tablet_manager.cc:1397] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d: Time spent bootstrapping tablet: real 0.022s user 0.013s sys 0.005s
I20260807 13:39:55.361935 23058 tablet_bootstrap.cc:492] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c: Bootstrap starting.
I20260807 13:39:55.363876 23056 raft_consensus.cc:348] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } }
I20260807 13:39:55.364730 23056 raft_consensus.cc:374] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:55.365056 23056 raft_consensus.cc:729] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc4e4942424c4427931538dabfc6b63d, State: Initialized, Role: FOLLOWER
I20260807 13:39:55.365871 23056 consensus_queue.cc:260] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } }
I20260807 13:39:55.367424 23055 tablet_bootstrap.cc:654] T 124b47385de445e08109ad645d366881 P d356524433a542328c096746bed5abef: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:55.368822 23058 tablet_bootstrap.cc:654] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:55.370918 23056 ts_tablet_manager.cc:1428] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d: Time spent starting tablet: real 0.010s user 0.004s sys 0.004s
I20260807 13:39:55.372033 23056 tablet_bootstrap.cc:492] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d: Bootstrap starting.
I20260807 13:39:55.384081 23056 tablet_bootstrap.cc:654] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:55.390736 23055 tablet_bootstrap.cc:492] T 124b47385de445e08109ad645d366881 P d356524433a542328c096746bed5abef: No bootstrap required, opened a new log
I20260807 13:39:55.391371 23055 ts_tablet_manager.cc:1397] T 124b47385de445e08109ad645d366881 P d356524433a542328c096746bed5abef: Time spent bootstrapping tablet: real 0.032s user 0.022s sys 0.007s
I20260807 13:39:55.391636 23056 tablet_bootstrap.cc:492] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d: No bootstrap required, opened a new log
I20260807 13:39:55.392102 23056 ts_tablet_manager.cc:1397] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d: Time spent bootstrapping tablet: real 0.020s user 0.010s sys 0.003s
I20260807 13:39:55.394340 23055 raft_consensus.cc:348] T 124b47385de445e08109ad645d366881 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.395292 23055 raft_consensus.cc:374] T 124b47385de445e08109ad645d366881 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:55.395695 23055 raft_consensus.cc:729] T 124b47385de445e08109ad645d366881 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d356524433a542328c096746bed5abef, State: Initialized, Role: FOLLOWER
I20260807 13:39:55.394495 23056 raft_consensus.cc:348] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.396696 23056 raft_consensus.cc:374] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:55.396983 23056 raft_consensus.cc:729] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc4e4942424c4427931538dabfc6b63d, State: Initialized, Role: FOLLOWER
I20260807 13:39:55.396497 23055 consensus_queue.cc:260] T 124b47385de445e08109ad645d366881 P d356524433a542328c096746bed5abef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.398097 23058 tablet_bootstrap.cc:492] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c: No bootstrap required, opened a new log
I20260807 13:39:55.397943 23056 consensus_queue.cc:260] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.398557 23058 ts_tablet_manager.cc:1397] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c: Time spent bootstrapping tablet: real 0.037s user 0.016s sys 0.009s
I20260807 13:39:55.398974 23055 ts_tablet_manager.cc:1428] T 124b47385de445e08109ad645d366881 P d356524433a542328c096746bed5abef: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260807 13:39:55.399960 23055 tablet_bootstrap.cc:492] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef: Bootstrap starting.
I20260807 13:39:55.401548 23058 raft_consensus.cc:348] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.402334 23058 raft_consensus.cc:374] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:55.402908 23058 raft_consensus.cc:729] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Initialized, Role: FOLLOWER
I20260807 13:39:55.402395 23056 ts_tablet_manager.cc:1428] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260807 13:39:55.403724 23058 consensus_queue.cc:260] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.405297 23056 tablet_bootstrap.cc:492] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d: Bootstrap starting.
I20260807 13:39:55.406505 23055 tablet_bootstrap.cc:654] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:55.408231 23058 ts_tablet_manager.cc:1428] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260807 13:39:55.409250 23058 tablet_bootstrap.cc:492] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c: Bootstrap starting.
I20260807 13:39:55.413053 23056 tablet_bootstrap.cc:654] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:55.415444 23058 tablet_bootstrap.cc:654] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:55.420943 23055 tablet_bootstrap.cc:492] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef: No bootstrap required, opened a new log
I20260807 13:39:55.421568 23055 ts_tablet_manager.cc:1397] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.012s
I20260807 13:39:55.424642 23056 tablet_bootstrap.cc:492] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d: No bootstrap required, opened a new log
I20260807 13:39:55.424501 23055 raft_consensus.cc:348] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.425184 23056 ts_tablet_manager.cc:1397] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d: Time spent bootstrapping tablet: real 0.020s user 0.007s sys 0.010s
I20260807 13:39:55.425309 23055 raft_consensus.cc:374] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:55.428671 23058 tablet_bootstrap.cc:492] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c: No bootstrap required, opened a new log
W20260807 13:39:55.428864 22708 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:39:55.429144 23058 ts_tablet_manager.cc:1397] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c: Time spent bootstrapping tablet: real 0.020s user 0.013s sys 0.005s
I20260807 13:39:55.427057 23055 raft_consensus.cc:729] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d356524433a542328c096746bed5abef, State: Initialized, Role: FOLLOWER
I20260807 13:39:55.428999 23056 raft_consensus.cc:348] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.430120 23056 raft_consensus.cc:374] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:55.430521 23056 raft_consensus.cc:729] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc4e4942424c4427931538dabfc6b63d, State: Initialized, Role: FOLLOWER
I20260807 13:39:55.430295 23055 consensus_queue.cc:260] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.431459 23056 consensus_queue.cc:260] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.432380 23058 raft_consensus.cc:348] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.433013 23055 ts_tablet_manager.cc:1428] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef: Time spent starting tablet: real 0.011s user 0.008s sys 0.000s
I20260807 13:39:55.433140 23058 raft_consensus.cc:374] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:55.433514 23058 raft_consensus.cc:729] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Initialized, Role: FOLLOWER
I20260807 13:39:55.434015 23055 tablet_bootstrap.cc:492] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef: Bootstrap starting.
I20260807 13:39:55.434312 23058 consensus_queue.cc:260] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.436182 23056 ts_tablet_manager.cc:1428] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260807 13:39:55.437381 23056 tablet_bootstrap.cc:492] T c9bbe03a111e4a43a9bc12b726d2748e P cc4e4942424c4427931538dabfc6b63d: Bootstrap starting.
I20260807 13:39:55.437842 23058 ts_tablet_manager.cc:1428] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c: Time spent starting tablet: real 0.008s user 0.006s sys 0.001s
I20260807 13:39:55.439113 23058 tablet_bootstrap.cc:492] T 124b47385de445e08109ad645d366881 P ce1db935895842f49ccbd894ab313d5c: Bootstrap starting.
I20260807 13:39:55.441327 23055 tablet_bootstrap.cc:654] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:55.447715 23058 tablet_bootstrap.cc:654] T 124b47385de445e08109ad645d366881 P ce1db935895842f49ccbd894ab313d5c: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:55.449084 23056 tablet_bootstrap.cc:654] T c9bbe03a111e4a43a9bc12b726d2748e P cc4e4942424c4427931538dabfc6b63d: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:55.454488 23055 tablet_bootstrap.cc:492] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef: No bootstrap required, opened a new log
I20260807 13:39:55.455248 23055 ts_tablet_manager.cc:1397] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef: Time spent bootstrapping tablet: real 0.021s user 0.018s sys 0.001s
I20260807 13:39:55.459488 23055 raft_consensus.cc:348] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.460559 23055 raft_consensus.cc:374] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:55.460909 23055 raft_consensus.cc:729] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d356524433a542328c096746bed5abef, State: Initialized, Role: FOLLOWER
I20260807 13:39:55.462404 23058 tablet_bootstrap.cc:492] T 124b47385de445e08109ad645d366881 P ce1db935895842f49ccbd894ab313d5c: No bootstrap required, opened a new log
I20260807 13:39:55.462953 23058 ts_tablet_manager.cc:1397] T 124b47385de445e08109ad645d366881 P ce1db935895842f49ccbd894ab313d5c: Time spent bootstrapping tablet: real 0.024s user 0.011s sys 0.007s
I20260807 13:39:55.462018 23055 consensus_queue.cc:260] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.465591 23055 ts_tablet_manager.cc:1428] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef: Time spent starting tablet: real 0.010s user 0.005s sys 0.003s
I20260807 13:39:55.466094 23058 raft_consensus.cc:348] T 124b47385de445e08109ad645d366881 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.466711 23055 tablet_bootstrap.cc:492] T d10115b832134c989a9752a1626893e6 P d356524433a542328c096746bed5abef: Bootstrap starting.
I20260807 13:39:55.466532 23062 raft_consensus.cc:482] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:55.466897 23058 raft_consensus.cc:374] T 124b47385de445e08109ad645d366881 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:55.467293 23058 raft_consensus.cc:729] T 124b47385de445e08109ad645d366881 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Initialized, Role: FOLLOWER
I20260807 13:39:55.467160 23062 raft_consensus.cc:504] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.468145 23058 consensus_queue.cc:260] T 124b47385de445e08109ad645d366881 P ce1db935895842f49ccbd894ab313d5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.471029 23058 ts_tablet_manager.cc:1428] T 124b47385de445e08109ad645d366881 P ce1db935895842f49ccbd894ab313d5c: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260807 13:39:55.472164 23058 tablet_bootstrap.cc:492] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P ce1db935895842f49ccbd894ab313d5c: Bootstrap starting.
I20260807 13:39:55.473205 23062 leader_election.cc:288] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693), cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489)
I20260807 13:39:55.474201 23055 tablet_bootstrap.cc:654] T d10115b832134c989a9752a1626893e6 P d356524433a542328c096746bed5abef: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:55.481062 23058 tablet_bootstrap.cc:654] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P ce1db935895842f49ccbd894ab313d5c: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:55.481271 23056 tablet_bootstrap.cc:492] T c9bbe03a111e4a43a9bc12b726d2748e P cc4e4942424c4427931538dabfc6b63d: No bootstrap required, opened a new log
I20260807 13:39:55.481952 23056 ts_tablet_manager.cc:1397] T c9bbe03a111e4a43a9bc12b726d2748e P cc4e4942424c4427931538dabfc6b63d: Time spent bootstrapping tablet: real 0.045s user 0.018s sys 0.005s
I20260807 13:39:55.485607 23056 raft_consensus.cc:348] T c9bbe03a111e4a43a9bc12b726d2748e P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.486619 23056 raft_consensus.cc:374] T c9bbe03a111e4a43a9bc12b726d2748e P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:55.487035 23056 raft_consensus.cc:729] T c9bbe03a111e4a43a9bc12b726d2748e P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc4e4942424c4427931538dabfc6b63d, State: Initialized, Role: FOLLOWER
I20260807 13:39:55.488131 23056 consensus_queue.cc:260] T c9bbe03a111e4a43a9bc12b726d2748e P cc4e4942424c4427931538dabfc6b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.492655 23058 tablet_bootstrap.cc:492] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P ce1db935895842f49ccbd894ab313d5c: No bootstrap required, opened a new log
I20260807 13:39:55.495599 23056 ts_tablet_manager.cc:1428] T c9bbe03a111e4a43a9bc12b726d2748e P cc4e4942424c4427931538dabfc6b63d: Time spent starting tablet: real 0.013s user 0.002s sys 0.009s
I20260807 13:39:55.496053 23058 ts_tablet_manager.cc:1397] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P ce1db935895842f49ccbd894ab313d5c: Time spent bootstrapping tablet: real 0.024s user 0.012s sys 0.005s
I20260807 13:39:55.496978 23056 tablet_bootstrap.cc:492] T 723969ccd114427893218ff642633ff4 P cc4e4942424c4427931538dabfc6b63d: Bootstrap starting.
I20260807 13:39:55.493076 23062 raft_consensus.cc:482] T 124b47385de445e08109ad645d366881 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:55.497638 23062 raft_consensus.cc:504] T 124b47385de445e08109ad645d366881 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.498907 23066 raft_consensus.cc:482] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:55.499365 23066 raft_consensus.cc:504] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.510627 23064 raft_consensus.cc:482] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:55.511233 23064 raft_consensus.cc:504] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.516644 23055 tablet_bootstrap.cc:492] T d10115b832134c989a9752a1626893e6 P d356524433a542328c096746bed5abef: No bootstrap required, opened a new log
I20260807 13:39:55.517526 23056 tablet_bootstrap.cc:654] T 723969ccd114427893218ff642633ff4 P cc4e4942424c4427931538dabfc6b63d: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:55.517700 23064 leader_election.cc:288] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489), d356524433a542328c096746bed5abef (127.21.82.67:36453)
I20260807 13:39:55.518486 23055 ts_tablet_manager.cc:1397] T d10115b832134c989a9752a1626893e6 P d356524433a542328c096746bed5abef: Time spent bootstrapping tablet: real 0.052s user 0.019s sys 0.028s
I20260807 13:39:55.522742 23055 raft_consensus.cc:348] T d10115b832134c989a9752a1626893e6 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.523851 23055 raft_consensus.cc:374] T d10115b832134c989a9752a1626893e6 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:55.524221 23055 raft_consensus.cc:729] T d10115b832134c989a9752a1626893e6 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d356524433a542328c096746bed5abef, State: Initialized, Role: FOLLOWER
I20260807 13:39:55.525183 23055 consensus_queue.cc:260] T d10115b832134c989a9752a1626893e6 P d356524433a542328c096746bed5abef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.526787 23066 leader_election.cc:288] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693), d356524433a542328c096746bed5abef (127.21.82.67:36453)
I20260807 13:39:55.545436 22884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9bbe03a111e4a43a9bc12b726d2748e" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc4e4942424c4427931538dabfc6b63d" is_pre_election: true
I20260807 13:39:55.546623 22884 raft_consensus.cc:2454] T c9bbe03a111e4a43a9bc12b726d2748e P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce1db935895842f49ccbd894ab313d5c in term 0.
I20260807 13:39:55.547098 23056 tablet_bootstrap.cc:492] T 723969ccd114427893218ff642633ff4 P cc4e4942424c4427931538dabfc6b63d: No bootstrap required, opened a new log
I20260807 13:39:55.547827 23056 ts_tablet_manager.cc:1397] T 723969ccd114427893218ff642633ff4 P cc4e4942424c4427931538dabfc6b63d: Time spent bootstrapping tablet: real 0.051s user 0.008s sys 0.009s
I20260807 13:39:55.548719 22738 leader_election.cc:302] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, ce1db935895842f49ccbd894ab313d5c; no voters:
I20260807 13:39:55.549892 23064 raft_consensus.cc:2781] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:39:55.550335 23064 raft_consensus.cc:482] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:55.550777 23064 raft_consensus.cc:3037] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:55.551668 23056 raft_consensus.cc:348] T 723969ccd114427893218ff642633ff4 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.552785 23056 raft_consensus.cc:374] T 723969ccd114427893218ff642633ff4 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:55.553215 23056 raft_consensus.cc:729] T 723969ccd114427893218ff642633ff4 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc4e4942424c4427931538dabfc6b63d, State: Initialized, Role: FOLLOWER
I20260807 13:39:55.554203 23056 consensus_queue.cc:260] T 723969ccd114427893218ff642633ff4 P cc4e4942424c4427931538dabfc6b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.557570 23056 ts_tablet_manager.cc:1428] T 723969ccd114427893218ff642633ff4 P cc4e4942424c4427931538dabfc6b63d: Time spent starting tablet: real 0.009s user 0.005s sys 0.003s
I20260807 13:39:55.562003 23056 tablet_bootstrap.cc:492] T b81bed43b6aa4d64953c7bd3b5f10d3c P cc4e4942424c4427931538dabfc6b63d: Bootstrap starting.
I20260807 13:39:55.570887 23056 tablet_bootstrap.cc:654] T b81bed43b6aa4d64953c7bd3b5f10d3c P cc4e4942424c4427931538dabfc6b63d: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:55.538230 23062 leader_election.cc:288] T 124b47385de445e08109ad645d366881 P d356524433a542328c096746bed5abef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693), cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489)
I20260807 13:39:55.584581 23056 tablet_bootstrap.cc:492] T b81bed43b6aa4d64953c7bd3b5f10d3c P cc4e4942424c4427931538dabfc6b63d: No bootstrap required, opened a new log
I20260807 13:39:55.585305 23056 ts_tablet_manager.cc:1397] T b81bed43b6aa4d64953c7bd3b5f10d3c P cc4e4942424c4427931538dabfc6b63d: Time spent bootstrapping tablet: real 0.024s user 0.008s sys 0.012s
I20260807 13:39:55.587471 23058 raft_consensus.cc:348] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.588521 23058 raft_consensus.cc:374] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:55.588835 23056 raft_consensus.cc:348] T b81bed43b6aa4d64953c7bd3b5f10d3c P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.589830 23056 raft_consensus.cc:374] T b81bed43b6aa4d64953c7bd3b5f10d3c P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:55.590190 23056 raft_consensus.cc:729] T b81bed43b6aa4d64953c7bd3b5f10d3c P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc4e4942424c4427931538dabfc6b63d, State: Initialized, Role: FOLLOWER
I20260807 13:39:55.591048 23056 consensus_queue.cc:260] T b81bed43b6aa4d64953c7bd3b5f10d3c P cc4e4942424c4427931538dabfc6b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.593951 23056 ts_tablet_manager.cc:1428] T b81bed43b6aa4d64953c7bd3b5f10d3c P cc4e4942424c4427931538dabfc6b63d: Time spent starting tablet: real 0.008s user 0.006s sys 0.002s
I20260807 13:39:55.588905 23058 raft_consensus.cc:729] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Initialized, Role: FOLLOWER
I20260807 13:39:55.595412 23058 consensus_queue.cc:260] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P ce1db935895842f49ccbd894ab313d5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.603716 23110 raft_consensus.cc:482] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:55.604622 23110 raft_consensus.cc:504] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.608484 23064 raft_consensus.cc:504] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.609892 23110 leader_election.cc:288] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489), d356524433a542328c096746bed5abef (127.21.82.67:36453)
I20260807 13:39:55.611378 22884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a635ded89e9c481bbd9d31bcd04ed678" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc4e4942424c4427931538dabfc6b63d" is_pre_election: true
I20260807 13:39:55.611901 23056 tablet_bootstrap.cc:492] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d: Bootstrap starting.
I20260807 13:39:55.612320 22884 raft_consensus.cc:2454] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce1db935895842f49ccbd894ab313d5c in term 0.
I20260807 13:39:55.613787 22882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9bbe03a111e4a43a9bc12b726d2748e" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
I20260807 13:39:55.614704 22882 raft_consensus.cc:3037] T c9bbe03a111e4a43a9bc12b726d2748e P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:55.618523 22738 leader_election.cc:302] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, ce1db935895842f49ccbd894ab313d5c; no voters:
I20260807 13:39:55.630981 23110 raft_consensus.cc:2781] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:39:55.631556 23110 raft_consensus.cc:482] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:55.632134 23110 raft_consensus.cc:3037] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:55.638206 23066 raft_consensus.cc:482] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:55.638900 23066 raft_consensus.cc:504] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } }
I20260807 13:39:55.641659 23066 leader_election.cc:288] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d356524433a542328c096746bed5abef (127.21.82.67:36453), ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693)
I20260807 13:39:55.646133 23066 raft_consensus.cc:482] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:55.646773 23066 raft_consensus.cc:504] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.649278 23066 leader_election.cc:288] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693), d356524433a542328c096746bed5abef (127.21.82.67:36453)
I20260807 13:39:55.653342 23064 leader_election.cc:288] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 1 election: Requested vote from peers cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489), d356524433a542328c096746bed5abef (127.21.82.67:36453)
I20260807 13:39:55.654062 23064 raft_consensus.cc:482] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:55.656445 23114 raft_consensus.cc:482] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:55.656977 23114 raft_consensus.cc:504] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.660143 22884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "723969ccd114427893218ff642633ff4" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc4e4942424c4427931538dabfc6b63d" is_pre_election: true
I20260807 13:39:55.660795 22884 raft_consensus.cc:2454] T 723969ccd114427893218ff642633ff4 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce1db935895842f49ccbd894ab313d5c in term 0.
I20260807 13:39:55.637718 22882 raft_consensus.cc:2454] T c9bbe03a111e4a43a9bc12b726d2748e P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce1db935895842f49ccbd894ab313d5c in term 1.
I20260807 13:39:55.662113 22738 leader_election.cc:302] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, ce1db935895842f49ccbd894ab313d5c; no voters:
I20260807 13:39:55.663313 23062 raft_consensus.cc:482] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:55.664207 23062 raft_consensus.cc:504] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.654613 23064 raft_consensus.cc:504] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.665855 23058 ts_tablet_manager.cc:1428] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P ce1db935895842f49ccbd894ab313d5c: Time spent starting tablet: real 0.169s user 0.010s sys 0.001s
I20260807 13:39:55.666267 23062 leader_election.cc:288] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693), cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489)
I20260807 13:39:55.668026 22884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507d17016e0d4daaa005e6cef4e44bbe" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc4e4942424c4427931538dabfc6b63d" is_pre_election: true
I20260807 13:39:55.669989 22738 leader_election.cc:302] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, ce1db935895842f49ccbd894ab313d5c; no voters:
I20260807 13:39:55.670373 23114 leader_election.cc:288] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489), d356524433a542328c096746bed5abef (127.21.82.67:36453)
I20260807 13:39:55.670536 23058 tablet_bootstrap.cc:492] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c: Bootstrap starting.
I20260807 13:39:55.675773 23110 raft_consensus.cc:504] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.679375 23064 leader_election.cc:288] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489), d356524433a542328c096746bed5abef (127.21.82.67:36453)
I20260807 13:39:55.681157 23056 tablet_bootstrap.cc:654] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:55.684262 23055 ts_tablet_manager.cc:1428] T d10115b832134c989a9752a1626893e6 P d356524433a542328c096746bed5abef: Time spent starting tablet: real 0.165s user 0.040s sys 0.074s
I20260807 13:39:55.686194 23055 tablet_bootstrap.cc:492] T a635ded89e9c481bbd9d31bcd04ed678 P d356524433a542328c096746bed5abef: Bootstrap starting.
I20260807 13:39:55.679942 23114 raft_consensus.cc:2781] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:39:55.693900 23055 tablet_bootstrap.cc:654] T a635ded89e9c481bbd9d31bcd04ed678 P d356524433a542328c096746bed5abef: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:55.686038 23064 raft_consensus.cc:2781] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:39:55.680171 23110 leader_election.cc:288] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 1 election: Requested vote from peers cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489), d356524433a542328c096746bed5abef (127.21.82.67:36453)
I20260807 13:39:55.695559 23064 raft_consensus.cc:686] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [term 1 LEADER]: Becoming Leader. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Running, Role: LEADER
I20260807 13:39:55.696533 22784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "124b47385de445e08109ad645d366881" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce1db935895842f49ccbd894ab313d5c" is_pre_election: true
I20260807 13:39:55.696969 23064 consensus_queue.cc:237] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.697422 22784 raft_consensus.cc:2454] T 124b47385de445e08109ad645d366881 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc4e4942424c4427931538dabfc6b63d in term 0.
I20260807 13:39:55.695881 23058 tablet_bootstrap.cc:654] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c: Neither blocks nor log segments found. Creating new log.
W20260807 13:39:55.698475 22738 leader_election.cc:341] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:55.698410 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e234587595554ae183f5b9604ba1c0b9" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce1db935895842f49ccbd894ab313d5c" is_pre_election: true
I20260807 13:39:55.701468 22781 raft_consensus.cc:2454] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc4e4942424c4427931538dabfc6b63d in term 0.
I20260807 13:39:55.694412 23114 raft_consensus.cc:482] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:55.702206 23114 raft_consensus.cc:3037] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:55.699477 22837 leader_election.cc:302] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, ce1db935895842f49ccbd894ab313d5c; no voters:
I20260807 13:39:55.699285 22780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d10115b832134c989a9752a1626893e6" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce1db935895842f49ccbd894ab313d5c" is_pre_election: true
I20260807 13:39:55.703279 22884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a635ded89e9c481bbd9d31bcd04ed678" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
I20260807 13:39:55.703280 22882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507d17016e0d4daaa005e6cef4e44bbe" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc4e4942424c4427931538dabfc6b63d" is_pre_election: true
I20260807 13:39:55.704043 22884 raft_consensus.cc:3037] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:55.704447 23066 raft_consensus.cc:2781] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:39:55.704818 23066 raft_consensus.cc:482] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:55.705862 23066 raft_consensus.cc:3037] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:55.703323 22837 leader_election.cc:302] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, ce1db935895842f49ccbd894ab313d5c; no voters:
I20260807 13:39:55.716665 22882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "124b47385de445e08109ad645d366881" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc4e4942424c4427931538dabfc6b63d" is_pre_election: true
I20260807 13:39:55.725447 22884 raft_consensus.cc:2454] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce1db935895842f49ccbd894ab313d5c in term 1.
I20260807 13:39:55.726125 23114 raft_consensus.cc:504] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.726624 22780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507d17016e0d4daaa005e6cef4e44bbe" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce1db935895842f49ccbd894ab313d5c" is_pre_election: true
I20260807 13:39:55.727077 22738 leader_election.cc:302] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, ce1db935895842f49ccbd894ab313d5c; no voters:
I20260807 13:39:55.728061 22784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69f0e9ea6b784ea89a5cb1fcc5a0293e" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce1db935895842f49ccbd894ab313d5c" is_pre_election: true
I20260807 13:39:55.728420 23114 leader_election.cc:288] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 1 election: Requested vote from peers cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489), d356524433a542328c096746bed5abef (127.21.82.67:36453)
I20260807 13:39:55.728739 22784 raft_consensus.cc:2454] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d356524433a542328c096746bed5abef in term 0.
I20260807 13:39:55.728976 23118 raft_consensus.cc:2781] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:39:55.729703 23118 raft_consensus.cc:686] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 1 LEADER]: Becoming Leader. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Running, Role: LEADER
I20260807 13:39:55.727321 22780 raft_consensus.cc:2454] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d356524433a542328c096746bed5abef in term 0.
W20260807 13:39:55.735796 22837 leader_election.cc:341] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:55.738248 23055 tablet_bootstrap.cc:492] T a635ded89e9c481bbd9d31bcd04ed678 P d356524433a542328c096746bed5abef: No bootstrap required, opened a new log
I20260807 13:39:55.738842 22881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "723969ccd114427893218ff642633ff4" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
I20260807 13:39:55.739588 22881 raft_consensus.cc:3037] T 723969ccd114427893218ff642633ff4 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:55.738845 23055 ts_tablet_manager.cc:1397] T a635ded89e9c481bbd9d31bcd04ed678 P d356524433a542328c096746bed5abef: Time spent bootstrapping tablet: real 0.054s user 0.024s sys 0.005s
I20260807 13:39:55.741787 23123 raft_consensus.cc:2781] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:39:55.742208 23123 raft_consensus.cc:482] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:55.742606 23123 raft_consensus.cc:3037] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:55.746071 23107 raft_consensus.cc:482] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:55.734360 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "124b47385de445e08109ad645d366881" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce1db935895842f49ccbd894ab313d5c" is_pre_election: true
I20260807 13:39:55.748034 22781 raft_consensus.cc:2454] T 124b47385de445e08109ad645d366881 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d356524433a542328c096746bed5abef in term 0.
I20260807 13:39:55.748071 22991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "124b47385de445e08109ad645d366881" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d356524433a542328c096746bed5abef" is_pre_election: true
I20260807 13:39:55.748908 22991 raft_consensus.cc:2454] T 124b47385de445e08109ad645d366881 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc4e4942424c4427931538dabfc6b63d in term 0.
I20260807 13:39:55.734830 23118 consensus_queue.cc:237] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.751309 22990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e234587595554ae183f5b9604ba1c0b9" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d356524433a542328c096746bed5abef" is_pre_election: true
I20260807 13:39:55.752097 22990 raft_consensus.cc:2454] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc4e4942424c4427931538dabfc6b63d in term 0.
I20260807 13:39:55.741092 22884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69f0e9ea6b784ea89a5cb1fcc5a0293e" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc4e4942424c4427931538dabfc6b63d" is_pre_election: true
I20260807 13:39:55.754527 22989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d10115b832134c989a9752a1626893e6" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d356524433a542328c096746bed5abef" is_pre_election: true
I20260807 13:39:55.755283 22989 raft_consensus.cc:2454] T d10115b832134c989a9752a1626893e6 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc4e4942424c4427931538dabfc6b63d in term 0.
I20260807 13:39:55.756664 23055 raft_consensus.cc:348] T a635ded89e9c481bbd9d31bcd04ed678 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.757503 23055 raft_consensus.cc:374] T a635ded89e9c481bbd9d31bcd04ed678 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:55.757766 23055 raft_consensus.cc:729] T a635ded89e9c481bbd9d31bcd04ed678 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d356524433a542328c096746bed5abef, State: Initialized, Role: FOLLOWER
I20260807 13:39:55.759274 23055 consensus_queue.cc:260] T a635ded89e9c481bbd9d31bcd04ed678 P d356524433a542328c096746bed5abef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.757735 23062 raft_consensus.cc:482] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:55.762564 23062 raft_consensus.cc:504] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.762962 22635 catalog_manager.cc:5495] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c reported cstate change: term changed from 0 to 1, leader changed from <none> to ce1db935895842f49ccbd894ab313d5c (127.21.82.65). New cstate: current_term: 1 leader_uuid: "ce1db935895842f49ccbd894ab313d5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:55.746601 23107 raft_consensus.cc:504] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.768033 23062 leader_election.cc:288] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693), cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489)
I20260807 13:39:55.770105 23107 leader_election.cc:288] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693), cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489)
I20260807 13:39:55.759394 23066 raft_consensus.cc:504] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.772712 22835 leader_election.cc:302] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, d356524433a542328c096746bed5abef; no voters: ce1db935895842f49ccbd894ab313d5c
I20260807 13:39:55.781992 22882 raft_consensus.cc:2379] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d356524433a542328c096746bed5abef in current term 1: Already voted for candidate cc4e4942424c4427931538dabfc6b63d in this term.
I20260807 13:39:55.783078 23126 raft_consensus.cc:482] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:39:55.780586 22942 leader_election.cc:341] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:55.770915 23123 raft_consensus.cc:504] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } }
W20260807 13:39:55.787349 22942 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:46489, user_credentials={real_user=slave}} blocked reactor thread for 66049.8us
I20260807 13:39:55.783645 23126 raft_consensus.cc:504] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.790359 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5872d5bc74e4657867e0d2cafb86ad6" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce1db935895842f49ccbd894ab313d5c" is_pre_election: true
I20260807 13:39:55.791633 23126 leader_election.cc:288] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693), d356524433a542328c096746bed5abef (127.21.82.67:36453)
I20260807 13:39:55.792449 23126 raft_consensus.cc:2781] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:39:55.790496 23056 tablet_bootstrap.cc:492] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d: No bootstrap required, opened a new log
I20260807 13:39:55.796197 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5872d5bc74e4657867e0d2cafb86ad6" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce1db935895842f49ccbd894ab313d5c" is_pre_election: true
I20260807 13:39:55.799335 23126 raft_consensus.cc:482] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:55.799283 22780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "124b47385de445e08109ad645d366881" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
I20260807 13:39:55.800446 23126 raft_consensus.cc:3037] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:55.801227 23056 ts_tablet_manager.cc:1397] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d: Time spent bootstrapping tablet: real 0.190s user 0.007s sys 0.018s
I20260807 13:39:55.786808 22881 raft_consensus.cc:2454] T 723969ccd114427893218ff642633ff4 P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce1db935895842f49ccbd894ab313d5c in term 1.
I20260807 13:39:55.802973 22780 raft_consensus.cc:3037] T 124b47385de445e08109ad645d366881 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:39:55.803792 22837 leader_election.cc:341] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:55.807289 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b81bed43b6aa4d64953c7bd3b5f10d3c" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce1db935895842f49ccbd894ab313d5c" is_pre_election: true
I20260807 13:39:55.810037 22942 leader_election.cc:302] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce1db935895842f49ccbd894ab313d5c, d356524433a542328c096746bed5abef; no voters:
I20260807 13:39:55.812474 22738 leader_election.cc:302] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, ce1db935895842f49ccbd894ab313d5c; no voters:
I20260807 13:39:55.813580 23064 raft_consensus.cc:2781] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:39:55.814107 23064 raft_consensus.cc:686] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c [term 1 LEADER]: Becoming Leader. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Running, Role: LEADER
I20260807 13:39:55.818549 23062 raft_consensus.cc:2781] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260807 13:39:55.819075 22835 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:36453, user_credentials={real_user=slave}} blocked reactor thread for 47499.7us
I20260807 13:39:55.819466 23062 raft_consensus.cc:482] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:55.819829 23062 raft_consensus.cc:3037] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:55.819410 22942 leader_election.cc:302] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce1db935895842f49ccbd894ab313d5c, d356524433a542328c096746bed5abef; no voters: cc4e4942424c4427931538dabfc6b63d
I20260807 13:39:55.820900 22989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5872d5bc74e4657867e0d2cafb86ad6" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d356524433a542328c096746bed5abef" is_pre_election: true
I20260807 13:39:55.821550 22989 raft_consensus.cc:2454] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc4e4942424c4427931538dabfc6b63d in term 0.
I20260807 13:39:55.821346 22942 leader_election.cc:302] T 124b47385de445e08109ad645d366881 P d356524433a542328c096746bed5abef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce1db935895842f49ccbd894ab313d5c, d356524433a542328c096746bed5abef; no voters:
I20260807 13:39:55.814956 23064 consensus_queue.cc:237] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.822398 23107 raft_consensus.cc:2781] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:39:55.843554 23055 ts_tablet_manager.cc:1428] T a635ded89e9c481bbd9d31bcd04ed678 P d356524433a542328c096746bed5abef: Time spent starting tablet: real 0.103s user 0.010s sys 0.035s
I20260807 13:39:55.823611 23066 leader_election.cc:288] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 1 election: Requested vote from peers ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693), d356524433a542328c096746bed5abef (127.21.82.67:36453)
I20260807 13:39:55.825992 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e234587595554ae183f5b9604ba1c0b9" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
I20260807 13:39:55.841660 22881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5872d5bc74e4657867e0d2cafb86ad6" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc4e4942424c4427931538dabfc6b63d" is_pre_election: true
I20260807 13:39:55.844794 23133 raft_consensus.cc:2781] T 124b47385de445e08109ad645d366881 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:39:55.840029 23056 raft_consensus.cc:348] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.849495 23056 raft_consensus.cc:374] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:55.849809 23056 raft_consensus.cc:729] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc4e4942424c4427931538dabfc6b63d, State: Initialized, Role: FOLLOWER
I20260807 13:39:55.847406 23107 raft_consensus.cc:482] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:55.850517 23056 consensus_queue.cc:260] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.849076 23055 tablet_bootstrap.cc:492] T 723969ccd114427893218ff642633ff4 P d356524433a542328c096746bed5abef: Bootstrap starting.
I20260807 13:39:55.840850 23058 tablet_bootstrap.cc:492] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c: No bootstrap required, opened a new log
I20260807 13:39:55.850831 22881 raft_consensus.cc:2454] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d356524433a542328c096746bed5abef in term 0.
I20260807 13:39:55.852159 23058 ts_tablet_manager.cc:1397] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c: Time spent bootstrapping tablet: real 0.182s user 0.021s sys 0.023s
I20260807 13:39:55.850766 23107 raft_consensus.cc:3037] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:55.829959 22989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e234587595554ae183f5b9604ba1c0b9" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d356524433a542328c096746bed5abef"
I20260807 13:39:55.823941 23123 leader_election.cc:288] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 1 election: Requested vote from peers d356524433a542328c096746bed5abef (127.21.82.67:36453), ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693)
W20260807 13:39:55.822575 22942 leader_election.cc:341] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:55.849927 23133 raft_consensus.cc:482] T 124b47385de445e08109ad645d366881 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:55.856468 22781 raft_consensus.cc:3037] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:55.863767 23056 ts_tablet_manager.cc:1428] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d: Time spent starting tablet: real 0.062s user 0.004s sys 0.004s
I20260807 13:39:55.865707 22881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b81bed43b6aa4d64953c7bd3b5f10d3c" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc4e4942424c4427931538dabfc6b63d" is_pre_election: true
I20260807 13:39:55.864207 22780 raft_consensus.cc:2454] T 124b47385de445e08109ad645d366881 P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc4e4942424c4427931538dabfc6b63d in term 1.
I20260807 13:39:55.866401 22881 raft_consensus.cc:2454] T b81bed43b6aa4d64953c7bd3b5f10d3c P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d356524433a542328c096746bed5abef in term 0.
I20260807 13:39:55.866444 22990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "124b47385de445e08109ad645d366881" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d356524433a542328c096746bed5abef"
I20260807 13:39:55.867268 23056 tablet_bootstrap.cc:492] T 507d17016e0d4daaa005e6cef4e44bbe P cc4e4942424c4427931538dabfc6b63d: Bootstrap starting.
I20260807 13:39:55.867554 22835 leader_election.cc:302] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, d356524433a542328c096746bed5abef; no voters: ce1db935895842f49ccbd894ab313d5c
I20260807 13:39:55.867697 23062 raft_consensus.cc:504] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.859516 22989 raft_consensus.cc:3037] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:55.862759 23133 raft_consensus.cc:3037] T 124b47385de445e08109ad645d366881 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:55.868901 23126 raft_consensus.cc:504] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.870766 22837 leader_election.cc:302] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, ce1db935895842f49ccbd894ab313d5c; no voters:
I20260807 13:39:55.871693 23066 raft_consensus.cc:2781] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:39:55.872160 23066 raft_consensus.cc:686] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [term 1 LEADER]: Becoming Leader. State: Replica: cc4e4942424c4427931538dabfc6b63d, State: Running, Role: LEADER
I20260807 13:39:55.872712 23126 leader_election.cc:288] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 1 election: Requested vote from peers ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693), d356524433a542328c096746bed5abef (127.21.82.67:36453)
I20260807 13:39:55.872987 23066 consensus_queue.cc:237] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.876741 23126 raft_consensus.cc:2781] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:39:55.877136 23126 raft_consensus.cc:482] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:55.877481 23126 raft_consensus.cc:3037] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:55.878225 22991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d10115b832134c989a9752a1626893e6" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d356524433a542328c096746bed5abef"
I20260807 13:39:55.879113 22991 raft_consensus.cc:3037] T d10115b832134c989a9752a1626893e6 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:55.873659 22780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d10115b832134c989a9752a1626893e6" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
I20260807 13:39:55.880970 23058 raft_consensus.cc:348] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.882315 23058 raft_consensus.cc:374] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260807 13:39:55.869273 22942 leader_election.cc:341] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:55.884581 23058 raft_consensus.cc:729] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Initialized, Role: FOLLOWER
W20260807 13:39:55.885576 22942 leader_election.cc:341] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:55.886767 23058 consensus_queue.cc:260] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.893502 23058 ts_tablet_manager.cc:1428] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c: Time spent starting tablet: real 0.041s user 0.007s sys 0.000s
I20260807 13:39:55.895051 23058 tablet_bootstrap.cc:492] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c: Bootstrap starting.
I20260807 13:39:55.895465 23055 tablet_bootstrap.cc:654] T 723969ccd114427893218ff642633ff4 P d356524433a542328c096746bed5abef: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:55.890360 22780 raft_consensus.cc:3037] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:55.897806 23056 tablet_bootstrap.cc:654] T 507d17016e0d4daaa005e6cef4e44bbe P cc4e4942424c4427931538dabfc6b63d: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:55.904482 22942 leader_election.cc:302] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, d356524433a542328c096746bed5abef; no voters: ce1db935895842f49ccbd894ab313d5c
I20260807 13:39:55.906198 23062 leader_election.cc:288] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [CANDIDATE]: Term 1 election: Requested vote from peers ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693), cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489)
I20260807 13:39:55.906883 23062 raft_consensus.cc:2781] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:39:55.907261 23062 raft_consensus.cc:482] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:55.907614 23062 raft_consensus.cc:3037] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:55.909078 22780 raft_consensus.cc:2454] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc4e4942424c4427931538dabfc6b63d in term 1.
I20260807 13:39:55.928556 22837 leader_election.cc:302] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, ce1db935895842f49ccbd894ab313d5c; no voters:
I20260807 13:39:55.933280 23066 raft_consensus.cc:2781] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:39:55.933491 22991 raft_consensus.cc:2454] T d10115b832134c989a9752a1626893e6 P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc4e4942424c4427931538dabfc6b63d in term 1.
I20260807 13:39:55.933854 23066 raft_consensus.cc:686] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [term 1 LEADER]: Becoming Leader. State: Replica: cc4e4942424c4427931538dabfc6b63d, State: Running, Role: LEADER
I20260807 13:39:55.934760 23066 consensus_queue.cc:237] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.939639 23062 raft_consensus.cc:504] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.942762 23056 tablet_bootstrap.cc:492] T 507d17016e0d4daaa005e6cef4e44bbe P cc4e4942424c4427931538dabfc6b63d: No bootstrap required, opened a new log
I20260807 13:39:55.943137 23062 leader_election.cc:288] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [CANDIDATE]: Term 1 election: Requested vote from peers ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693), cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489)
I20260807 13:39:55.943264 23056 ts_tablet_manager.cc:1397] T 507d17016e0d4daaa005e6cef4e44bbe P cc4e4942424c4427931538dabfc6b63d: Time spent bootstrapping tablet: real 0.079s user 0.016s sys 0.002s
I20260807 13:39:55.940531 22989 raft_consensus.cc:2454] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc4e4942424c4427931538dabfc6b63d in term 1.
I20260807 13:39:55.947656 22835 leader_election.cc:302] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, d356524433a542328c096746bed5abef; no voters:
I20260807 13:39:55.949059 23123 raft_consensus.cc:2781] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:39:55.931037 22942 leader_election.cc:302] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, d356524433a542328c096746bed5abef; no voters: ce1db935895842f49ccbd894ab313d5c
I20260807 13:39:55.950984 23123 raft_consensus.cc:686] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [term 1 LEADER]: Becoming Leader. State: Replica: cc4e4942424c4427931538dabfc6b63d, State: Running, Role: LEADER
I20260807 13:39:55.955190 23123 consensus_queue.cc:237] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } }
I20260807 13:39:55.967172 23107 raft_consensus.cc:504] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.952771 23062 raft_consensus.cc:2781] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:39:55.987645 23062 raft_consensus.cc:482] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:55.988191 23062 raft_consensus.cc:3037] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:55.988899 23107 leader_election.cc:288] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [CANDIDATE]: Term 1 election: Requested vote from peers ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693), cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489)
I20260807 13:39:55.973136 23056 raft_consensus.cc:348] T 507d17016e0d4daaa005e6cef4e44bbe P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.948808 22636 catalog_manager.cc:5495] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d reported cstate change: term changed from 0 to 1, leader changed from <none> to cc4e4942424c4427931538dabfc6b63d (127.21.82.66). New cstate: current_term: 1 leader_uuid: "cc4e4942424c4427931538dabfc6b63d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:55.981402 22780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69f0e9ea6b784ea89a5cb1fcc5a0293e" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
I20260807 13:39:55.985770 23133 raft_consensus.cc:504] T 124b47385de445e08109ad645d366881 P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.991039 22780 raft_consensus.cc:3037] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:55.991851 22990 raft_consensus.cc:2379] T 124b47385de445e08109ad645d366881 P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cc4e4942424c4427931538dabfc6b63d in current term 1: Already voted for candidate d356524433a542328c096746bed5abef in this term.
I20260807 13:39:55.990125 23056 raft_consensus.cc:374] T 507d17016e0d4daaa005e6cef4e44bbe P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:55.994976 23056 raft_consensus.cc:729] T 507d17016e0d4daaa005e6cef4e44bbe P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc4e4942424c4427931538dabfc6b63d, State: Initialized, Role: FOLLOWER
I20260807 13:39:55.999961 23062 raft_consensus.cc:504] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:56.005257 23062 leader_election.cc:288] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [CANDIDATE]: Term 1 election: Requested vote from peers ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693), cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489)
I20260807 13:39:56.005330 23126 raft_consensus.cc:504] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:55.998557 22780 raft_consensus.cc:2454] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d356524433a542328c096746bed5abef in term 1.
I20260807 13:39:56.016973 22881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69f0e9ea6b784ea89a5cb1fcc5a0293e" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
I20260807 13:39:56.018287 22784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5872d5bc74e4657867e0d2cafb86ad6" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
I20260807 13:39:56.016947 23123 raft_consensus.cc:482] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:56.020632 23056 consensus_queue.cc:260] T 507d17016e0d4daaa005e6cef4e44bbe P cc4e4942424c4427931538dabfc6b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:56.021380 23123 raft_consensus.cc:504] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:56.022768 22881 raft_consensus.cc:3037] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:56.024879 22781 raft_consensus.cc:2454] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc4e4942424c4427931538dabfc6b63d in term 1.
I20260807 13:39:56.024673 22780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5872d5bc74e4657867e0d2cafb86ad6" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
W20260807 13:39:56.026418 22837 leader_election.cc:341] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:56.027150 22882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5872d5bc74e4657867e0d2cafb86ad6" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
I20260807 13:39:56.027890 23123 leader_election.cc:288] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693), d356524433a542328c096746bed5abef (127.21.82.67:36453)
I20260807 13:39:56.028020 22882 raft_consensus.cc:2379] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d356524433a542328c096746bed5abef in current term 1: Already voted for candidate cc4e4942424c4427931538dabfc6b63d in this term.
I20260807 13:39:56.028549 22990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5872d5bc74e4657867e0d2cafb86ad6" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d356524433a542328c096746bed5abef"
I20260807 13:39:56.029587 22990 raft_consensus.cc:2379] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cc4e4942424c4427931538dabfc6b63d in current term 1: Already voted for candidate d356524433a542328c096746bed5abef in this term.
I20260807 13:39:56.032615 22835 leader_election.cc:302] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d; no voters: ce1db935895842f49ccbd894ab313d5c, d356524433a542328c096746bed5abef
I20260807 13:39:56.033805 23055 tablet_bootstrap.cc:492] T 723969ccd114427893218ff642633ff4 P d356524433a542328c096746bed5abef: No bootstrap required, opened a new log
I20260807 13:39:56.034243 23055 ts_tablet_manager.cc:1397] T 723969ccd114427893218ff642633ff4 P d356524433a542328c096746bed5abef: Time spent bootstrapping tablet: real 0.185s user 0.018s sys 0.012s
I20260807 13:39:56.034313 23066 raft_consensus.cc:2726] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:39:56.035511 23058 tablet_bootstrap.cc:654] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:56.036051 23056 ts_tablet_manager.cc:1428] T 507d17016e0d4daaa005e6cef4e44bbe P cc4e4942424c4427931538dabfc6b63d: Time spent starting tablet: real 0.092s user 0.006s sys 0.008s
I20260807 13:39:56.034710 22990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69f0e9ea6b784ea89a5cb1fcc5a0293e" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d356524433a542328c096746bed5abef" is_pre_election: true
I20260807 13:39:56.037021 22780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69f0e9ea6b784ea89a5cb1fcc5a0293e" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce1db935895842f49ccbd894ab313d5c" is_pre_election: true
I20260807 13:39:56.037204 22990 raft_consensus.cc:2379] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc4e4942424c4427931538dabfc6b63d in current term 1: Already voted for candidate d356524433a542328c096746bed5abef in this term.
I20260807 13:39:56.037567 22780 raft_consensus.cc:2379] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc4e4942424c4427931538dabfc6b63d in current term 1: Already voted for candidate d356524433a542328c096746bed5abef in this term.
I20260807 13:39:56.038095 23062 raft_consensus.cc:482] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:56.038534 23062 raft_consensus.cc:504] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:56.040390 23133 leader_election.cc:288] T 124b47385de445e08109ad645d366881 P d356524433a542328c096746bed5abef [CANDIDATE]: Term 1 election: Requested vote from peers ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693), cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489)
I20260807 13:39:56.040472 22837 leader_election.cc:302] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d; no voters: ce1db935895842f49ccbd894ab313d5c, d356524433a542328c096746bed5abef
I20260807 13:39:56.041347 23055 raft_consensus.cc:348] T 723969ccd114427893218ff642633ff4 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:56.042583 23055 raft_consensus.cc:374] T 723969ccd114427893218ff642633ff4 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:56.042904 23055 raft_consensus.cc:729] T 723969ccd114427893218ff642633ff4 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d356524433a542328c096746bed5abef, State: Initialized, Role: FOLLOWER
I20260807 13:39:56.033609 23126 leader_election.cc:288] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 1 election: Requested vote from peers ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693), d356524433a542328c096746bed5abef (127.21.82.67:36453)
I20260807 13:39:56.044286 23055 consensus_queue.cc:260] T 723969ccd114427893218ff642633ff4 P d356524433a542328c096746bed5abef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:56.045460 22989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a635ded89e9c481bbd9d31bcd04ed678" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d356524433a542328c096746bed5abef" is_pre_election: true
I20260807 13:39:56.045635 23062 leader_election.cc:288] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693), cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489)
I20260807 13:39:56.045668 22991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9bbe03a111e4a43a9bc12b726d2748e" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d356524433a542328c096746bed5abef"
I20260807 13:39:56.046139 22989 raft_consensus.cc:2454] T a635ded89e9c481bbd9d31bcd04ed678 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce1db935895842f49ccbd894ab313d5c in term 0.
I20260807 13:39:56.046356 22991 raft_consensus.cc:3037] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:56.047006 22985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507d17016e0d4daaa005e6cef4e44bbe" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d356524433a542328c096746bed5abef" is_pre_election: true
I20260807 13:39:56.048133 22988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "723969ccd114427893218ff642633ff4" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d356524433a542328c096746bed5abef" is_pre_election: true
I20260807 13:39:56.051199 22989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "723969ccd114427893218ff642633ff4" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d356524433a542328c096746bed5abef"
I20260807 13:39:56.051661 22990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9bbe03a111e4a43a9bc12b726d2748e" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d356524433a542328c096746bed5abef" is_pre_election: true
I20260807 13:39:56.051856 22988 raft_consensus.cc:2454] T 723969ccd114427893218ff642633ff4 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce1db935895842f49ccbd894ab313d5c in term 0.
I20260807 13:39:56.049340 22987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a635ded89e9c481bbd9d31bcd04ed678" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d356524433a542328c096746bed5abef"
I20260807 13:39:56.053577 22987 raft_consensus.cc:3037] T a635ded89e9c481bbd9d31bcd04ed678 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:56.049419 22985 raft_consensus.cc:2379] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce1db935895842f49ccbd894ab313d5c in current term 1: Already voted for candidate d356524433a542328c096746bed5abef in this term.
I20260807 13:39:56.054108 22635 catalog_manager.cc:5495] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c reported cstate change: term changed from 0 to 1, leader changed from <none> to ce1db935895842f49ccbd894ab313d5c (127.21.82.65). New cstate: current_term: 1 leader_uuid: "ce1db935895842f49ccbd894ab313d5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:56.059468 22635 catalog_manager.cc:5495] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c reported cstate change: term changed from 0 to 1, leader changed from <none> to ce1db935895842f49ccbd894ab313d5c (127.21.82.65). New cstate: current_term: 1 leader_uuid: "ce1db935895842f49ccbd894ab313d5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:56.060818 22882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507d17016e0d4daaa005e6cef4e44bbe" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
I20260807 13:39:56.061861 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b81bed43b6aa4d64953c7bd3b5f10d3c" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
I20260807 13:39:56.062126 22882 raft_consensus.cc:3037] T 507d17016e0d4daaa005e6cef4e44bbe P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:56.061893 22780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507d17016e0d4daaa005e6cef4e44bbe" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
I20260807 13:39:56.063661 22780 raft_consensus.cc:3037] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:56.067469 22987 raft_consensus.cc:2454] T a635ded89e9c481bbd9d31bcd04ed678 P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce1db935895842f49ccbd894ab313d5c in term 1.
I20260807 13:39:56.050809 22881 raft_consensus.cc:2454] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d356524433a542328c096746bed5abef in term 1.
I20260807 13:39:56.068658 23066 raft_consensus.cc:2726] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:39:56.068907 22991 raft_consensus.cc:2454] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce1db935895842f49ccbd894ab313d5c in term 1.
I20260807 13:39:56.069850 23055 ts_tablet_manager.cc:1428] T 723969ccd114427893218ff642633ff4 P d356524433a542328c096746bed5abef: Time spent starting tablet: real 0.035s user 0.006s sys 0.000s
I20260807 13:39:56.069693 22884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b81bed43b6aa4d64953c7bd3b5f10d3c" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
I20260807 13:39:56.070326 22884 raft_consensus.cc:3037] T b81bed43b6aa4d64953c7bd3b5f10d3c P cc4e4942424c4427931538dabfc6b63d [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:56.071125 22882 raft_consensus.cc:2454] T 507d17016e0d4daaa005e6cef4e44bbe P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d356524433a542328c096746bed5abef in term 1.
I20260807 13:39:56.077992 22884 raft_consensus.cc:2454] T b81bed43b6aa4d64953c7bd3b5f10d3c P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d356524433a542328c096746bed5abef in term 1.
I20260807 13:39:56.079823 22882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "124b47385de445e08109ad645d366881" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
I20260807 13:39:56.079855 22784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9bbe03a111e4a43a9bc12b726d2748e" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce1db935895842f49ccbd894ab313d5c" is_pre_election: true
I20260807 13:39:56.081100 22881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9bbe03a111e4a43a9bc12b726d2748e" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc4e4942424c4427931538dabfc6b63d" is_pre_election: true
I20260807 13:39:56.081830 22881 raft_consensus.cc:2379] T c9bbe03a111e4a43a9bc12b726d2748e P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d356524433a542328c096746bed5abef in current term 1: Already voted for candidate ce1db935895842f49ccbd894ab313d5c in this term.
I20260807 13:39:56.082774 23058 tablet_bootstrap.cc:492] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c: No bootstrap required, opened a new log
I20260807 13:39:56.083238 23058 ts_tablet_manager.cc:1397] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c: Time spent bootstrapping tablet: real 0.189s user 0.036s sys 0.017s
I20260807 13:39:56.083187 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "124b47385de445e08109ad645d366881" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
I20260807 13:39:56.083600 22942 leader_election.cc:302] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, d356524433a542328c096746bed5abef; no voters:
I20260807 13:39:56.084393 22781 raft_consensus.cc:2379] T 124b47385de445e08109ad645d366881 P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d356524433a542328c096746bed5abef in current term 1: Already voted for candidate cc4e4942424c4427931538dabfc6b63d in this term.
I20260807 13:39:56.084450 23133 raft_consensus.cc:2781] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:39:56.084582 22942 leader_election.cc:302] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, d356524433a542328c096746bed5abef; no voters:
I20260807 13:39:56.085139 23133 raft_consensus.cc:686] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [term 1 LEADER]: Becoming Leader. State: Replica: d356524433a542328c096746bed5abef, State: Running, Role: LEADER
I20260807 13:39:56.085691 23107 raft_consensus.cc:2781] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:39:56.086129 23107 raft_consensus.cc:686] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [term 1 LEADER]: Becoming Leader. State: Replica: d356524433a542328c096746bed5abef, State: Running, Role: LEADER
I20260807 13:39:56.086045 23133 consensus_queue.cc:237] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:56.087112 22942 leader_election.cc:302] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, d356524433a542328c096746bed5abef; no voters:
I20260807 13:39:56.087193 23107 consensus_queue.cc:237] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:56.088297 23141 raft_consensus.cc:2781] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:39:56.088752 23141 raft_consensus.cc:686] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [term 1 LEADER]: Becoming Leader. State: Replica: d356524433a542328c096746bed5abef, State: Running, Role: LEADER
I20260807 13:39:56.089656 23141 consensus_queue.cc:237] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:56.091627 22780 raft_consensus.cc:2454] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d356524433a542328c096746bed5abef in term 1.
I20260807 13:39:56.092650 23058 raft_consensus.cc:348] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:56.093384 23058 raft_consensus.cc:374] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:56.093683 23058 raft_consensus.cc:729] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Initialized, Role: FOLLOWER
I20260807 13:39:56.094396 23058 consensus_queue.cc:260] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:56.105028 23058 ts_tablet_manager.cc:1428] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c: Time spent starting tablet: real 0.021s user 0.006s sys 0.000s
I20260807 13:39:56.106055 23058 tablet_bootstrap.cc:492] T b81bed43b6aa4d64953c7bd3b5f10d3c P ce1db935895842f49ccbd894ab313d5c: Bootstrap starting.
W20260807 13:39:56.108392 22942 leader_election.cc:341] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:56.108906 22942 leader_election.cc:302] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d356524433a542328c096746bed5abef; no voters: cc4e4942424c4427931538dabfc6b63d, ce1db935895842f49ccbd894ab313d5c
I20260807 13:39:56.109725 23141 raft_consensus.cc:2726] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260807 13:39:56.110142 22942 leader_election.cc:341] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:56.111464 22942 leader_election.cc:302] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d356524433a542328c096746bed5abef; no voters: cc4e4942424c4427931538dabfc6b63d, ce1db935895842f49ccbd894ab313d5c
I20260807 13:39:56.111783 23058 tablet_bootstrap.cc:654] T b81bed43b6aa4d64953c7bd3b5f10d3c P ce1db935895842f49ccbd894ab313d5c: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:56.112246 23141 raft_consensus.cc:2726] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:39:56.112716 22942 leader_election.cc:302] T 124b47385de445e08109ad645d366881 P d356524433a542328c096746bed5abef [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d356524433a542328c096746bed5abef; no voters: cc4e4942424c4427931538dabfc6b63d, ce1db935895842f49ccbd894ab313d5c
I20260807 13:39:56.113518 23141 raft_consensus.cc:2726] T 124b47385de445e08109ad645d366881 P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:39:56.116559 22736 leader_election.cc:302] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce1db935895842f49ccbd894ab313d5c; no voters: cc4e4942424c4427931538dabfc6b63d, d356524433a542328c096746bed5abef
I20260807 13:39:56.117599 23064 raft_consensus.cc:2726] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:39:56.118134 23058 tablet_bootstrap.cc:492] T b81bed43b6aa4d64953c7bd3b5f10d3c P ce1db935895842f49ccbd894ab313d5c: No bootstrap required, opened a new log
I20260807 13:39:56.118620 23058 ts_tablet_manager.cc:1397] T b81bed43b6aa4d64953c7bd3b5f10d3c P ce1db935895842f49ccbd894ab313d5c: Time spent bootstrapping tablet: real 0.013s user 0.010s sys 0.002s
I20260807 13:39:56.118319 22637 catalog_manager.cc:5495] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d reported cstate change: term changed from 0 to 1, leader changed from <none> to cc4e4942424c4427931538dabfc6b63d (127.21.82.66). New cstate: current_term: 1 leader_uuid: "cc4e4942424c4427931538dabfc6b63d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:56.120983 22637 catalog_manager.cc:5495] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d reported cstate change: term changed from 0 to 1, leader changed from <none> to cc4e4942424c4427931538dabfc6b63d (127.21.82.66). New cstate: current_term: 1 leader_uuid: "cc4e4942424c4427931538dabfc6b63d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:56.122167 23058 raft_consensus.cc:348] T b81bed43b6aa4d64953c7bd3b5f10d3c P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:56.122972 23058 raft_consensus.cc:374] T b81bed43b6aa4d64953c7bd3b5f10d3c P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:56.123224 23058 raft_consensus.cc:729] T b81bed43b6aa4d64953c7bd3b5f10d3c P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Initialized, Role: FOLLOWER
I20260807 13:39:56.123831 23058 consensus_queue.cc:260] T b81bed43b6aa4d64953c7bd3b5f10d3c P ce1db935895842f49ccbd894ab313d5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:56.125679 23058 ts_tablet_manager.cc:1428] T b81bed43b6aa4d64953c7bd3b5f10d3c P ce1db935895842f49ccbd894ab313d5c: Time spent starting tablet: real 0.007s user 0.000s sys 0.003s
I20260807 13:39:56.132975 23064 consensus_queue.cc:1035] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:39:56.136046 22635 catalog_manager.cc:5495] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef reported cstate change: term changed from 0 to 1, leader changed from <none> to d356524433a542328c096746bed5abef (127.21.82.67). New cstate: current_term: 1 leader_uuid: "d356524433a542328c096746bed5abef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } health_report { overall_health: HEALTHY } } }
I20260807 13:39:56.138010 22635 catalog_manager.cc:5495] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef reported cstate change: term changed from 0 to 1, leader changed from <none> to d356524433a542328c096746bed5abef (127.21.82.67). New cstate: current_term: 1 leader_uuid: "d356524433a542328c096746bed5abef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } health_report { overall_health: HEALTHY } } }
I20260807 13:39:56.139856 22635 catalog_manager.cc:5495] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef reported cstate change: term changed from 0 to 1, leader changed from <none> to d356524433a542328c096746bed5abef (127.21.82.67). New cstate: current_term: 1 leader_uuid: "d356524433a542328c096746bed5abef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } health_report { overall_health: HEALTHY } } }
I20260807 13:39:56.162027 23118 consensus_queue.cc:1035] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:39:56.196561 23110 consensus_queue.cc:1035] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:39:56.208009 23114 consensus_queue.cc:1035] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:39:56.248158 23114 consensus_queue.cc:1035] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:39:56.259018 22991 raft_consensus.cc:3037] T 723969ccd114427893218ff642633ff4 P d356524433a542328c096746bed5abef [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:56.266978 23114 consensus_queue.cc:1035] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:39:56.335565 23114 raft_consensus.cc:482] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:56.336071 23114 raft_consensus.cc:504] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:56.337208 23066 consensus_queue.cc:1035] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:39:56.337832 23114 leader_election.cc:288] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489), d356524433a542328c096746bed5abef (127.21.82.67:36453)
I20260807 13:39:56.339219 22991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5872d5bc74e4657867e0d2cafb86ad6" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d356524433a542328c096746bed5abef" is_pre_election: true
I20260807 13:39:56.339154 22884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5872d5bc74e4657867e0d2cafb86ad6" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc4e4942424c4427931538dabfc6b63d" is_pre_election: true
I20260807 13:39:56.340277 22991 raft_consensus.cc:2379] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce1db935895842f49ccbd894ab313d5c in current term 1: Already voted for candidate d356524433a542328c096746bed5abef in this term.
I20260807 13:39:56.340322 22884 raft_consensus.cc:2379] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce1db935895842f49ccbd894ab313d5c in current term 1: Already voted for candidate cc4e4942424c4427931538dabfc6b63d in this term.
I20260807 13:39:56.341547 22738 leader_election.cc:302] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce1db935895842f49ccbd894ab313d5c; no voters: cc4e4942424c4427931538dabfc6b63d, d356524433a542328c096746bed5abef
I20260807 13:39:56.342265 23114 raft_consensus.cc:3037] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:56.350258 23066 consensus_queue.cc:1035] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:39:56.355406 23114 raft_consensus.cc:2726] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:39:56.366042 23066 consensus_queue.cc:1035] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:39:56.376792 23126 consensus_queue.cc:1035] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260807 13:39:56.435997 22708 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:39:56.486641 23126 consensus_queue.cc:1035] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:39:56.495106 22780 raft_consensus.cc:3037] T b81bed43b6aa4d64953c7bd3b5f10d3c P ce1db935895842f49ccbd894ab313d5c [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:56.499910 23126 consensus_queue.cc:1035] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:39:56.504457 23141 consensus_queue.cc:1035] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:39:56.517645 23141 consensus_queue.cc:1035] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:39:56.577131 23141 consensus_queue.cc:1035] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:39:56.588682 23141 consensus_queue.cc:1035] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:39:56.626821 23141 consensus_queue.cc:1035] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:39:56.637969 23133 consensus_queue.cc:1035] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:39:57.443267 22708 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:39:57.585901 23123 raft_consensus.cc:482] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:57.586565 23123 raft_consensus.cc:504] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:57.588438 23123 leader_election.cc:288] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693), d356524433a542328c096746bed5abef (127.21.82.67:36453)
I20260807 13:39:57.589424 22780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5872d5bc74e4657867e0d2cafb86ad6" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce1db935895842f49ccbd894ab313d5c" is_pre_election: true
I20260807 13:39:57.589835 22987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5872d5bc74e4657867e0d2cafb86ad6" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d356524433a542328c096746bed5abef" is_pre_election: true
I20260807 13:39:57.590173 22780 raft_consensus.cc:2454] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc4e4942424c4427931538dabfc6b63d in term 1.
I20260807 13:39:57.590456 22987 raft_consensus.cc:2454] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc4e4942424c4427931538dabfc6b63d in term 1.
I20260807 13:39:57.591562 22837 leader_election.cc:302] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, ce1db935895842f49ccbd894ab313d5c; no voters:
I20260807 13:39:57.592260 23123 raft_consensus.cc:2781] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:39:57.592595 23123 raft_consensus.cc:482] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:57.592820 23123 raft_consensus.cc:3037] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:57.598165 23123 raft_consensus.cc:504] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:57.599886 23123 leader_election.cc:288] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 2 election: Requested vote from peers ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693), d356524433a542328c096746bed5abef (127.21.82.67:36453)
I20260807 13:39:57.600818 22780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5872d5bc74e4657867e0d2cafb86ad6" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
I20260807 13:39:57.601006 22987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5872d5bc74e4657867e0d2cafb86ad6" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d356524433a542328c096746bed5abef"
I20260807 13:39:57.601341 22780 raft_consensus.cc:3037] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:57.601568 22987 raft_consensus.cc:3037] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:57.606221 22987 raft_consensus.cc:2454] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc4e4942424c4427931538dabfc6b63d in term 2.
I20260807 13:39:57.606225 22780 raft_consensus.cc:2454] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc4e4942424c4427931538dabfc6b63d in term 2.
I20260807 13:39:57.607630 22835 leader_election.cc:302] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, d356524433a542328c096746bed5abef; no voters:
I20260807 13:39:57.608422 23123 raft_consensus.cc:2781] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:39:57.609408 23123 raft_consensus.cc:686] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 2 LEADER]: Becoming Leader. State: Replica: cc4e4942424c4427931538dabfc6b63d, State: Running, Role: LEADER
I20260807 13:39:57.610248 23123 consensus_queue.cc:237] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:57.617120 22635 catalog_manager.cc:5495] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d reported cstate change: term changed from 0 to 2, leader changed from <none> to cc4e4942424c4427931538dabfc6b63d (127.21.82.66). New cstate: current_term: 2 leader_uuid: "cc4e4942424c4427931538dabfc6b63d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:57.688446 22884 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e234587595554ae183f5b9604ba1c0b9"
dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
mode: GRACEFUL
new_leader_uuid: "ce1db935895842f49ccbd894ab313d5c"
from {username='slave'} at 127.0.0.1:51378
I20260807 13:39:57.689139 22884 raft_consensus.cc:595] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [term 1 LEADER]: Received request to transfer leadership to TS ce1db935895842f49ccbd894ab313d5c
I20260807 13:39:57.704684 22987 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b81bed43b6aa4d64953c7bd3b5f10d3c"
dest_uuid: "d356524433a542328c096746bed5abef"
mode: GRACEFUL
new_leader_uuid: "ce1db935895842f49ccbd894ab313d5c"
from {username='slave'} at 127.0.0.1:39244
I20260807 13:39:57.705293 22987 raft_consensus.cc:595] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [term 1 LEADER]: Received request to transfer leadership to TS ce1db935895842f49ccbd894ab313d5c
I20260807 13:39:57.710242 22884 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "124b47385de445e08109ad645d366881"
dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
mode: GRACEFUL
new_leader_uuid: "ce1db935895842f49ccbd894ab313d5c"
from {username='slave'} at 127.0.0.1:51378
I20260807 13:39:57.710829 22884 raft_consensus.cc:595] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [term 1 LEADER]: Received request to transfer leadership to TS ce1db935895842f49ccbd894ab313d5c
I20260807 13:39:57.715690 22987 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "507d17016e0d4daaa005e6cef4e44bbe"
dest_uuid: "d356524433a542328c096746bed5abef"
mode: GRACEFUL
new_leader_uuid: "ce1db935895842f49ccbd894ab313d5c"
from {username='slave'} at 127.0.0.1:39244
I20260807 13:39:57.716382 22987 raft_consensus.cc:595] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [term 1 LEADER]: Received request to transfer leadership to TS ce1db935895842f49ccbd894ab313d5c
I20260807 13:39:57.737602 22780 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a635ded89e9c481bbd9d31bcd04ed678"
dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
mode: GRACEFUL
new_leader_uuid: "cc4e4942424c4427931538dabfc6b63d"
from {username='slave'} at 127.0.0.1:53382
I20260807 13:39:57.738193 22780 raft_consensus.cc:595] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 1 LEADER]: Received request to transfer leadership to TS cc4e4942424c4427931538dabfc6b63d
I20260807 13:39:57.745805 22987 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "69f0e9ea6b784ea89a5cb1fcc5a0293e"
dest_uuid: "d356524433a542328c096746bed5abef"
mode: GRACEFUL
new_leader_uuid: "cc4e4942424c4427931538dabfc6b63d"
from {username='slave'} at 127.0.0.1:39244
I20260807 13:39:57.746385 22987 raft_consensus.cc:595] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [term 1 LEADER]: Received request to transfer leadership to TS cc4e4942424c4427931538dabfc6b63d
I20260807 13:39:57.750865 22780 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "723969ccd114427893218ff642633ff4"
dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
mode: GRACEFUL
new_leader_uuid: "d356524433a542328c096746bed5abef"
from {username='slave'} at 127.0.0.1:53382
I20260807 13:39:57.751405 22780 raft_consensus.cc:595] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c [term 1 LEADER]: Received request to transfer leadership to TS d356524433a542328c096746bed5abef
I20260807 13:39:57.766954 23200 raft_consensus.cc:979] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c: : Instructing follower d356524433a542328c096746bed5abef to start an election
I20260807 13:39:57.767462 23118 raft_consensus.cc:1067] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c [term 1 LEADER]: Signalling peer d356524433a542328c096746bed5abef to start an election
I20260807 13:39:57.769177 22987 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "723969ccd114427893218ff642633ff4"
dest_uuid: "d356524433a542328c096746bed5abef"
from {username='slave'} at 127.0.0.1:39240
I20260807 13:39:57.769716 22987 raft_consensus.cc:482] T 723969ccd114427893218ff642633ff4 P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:39:57.770085 22987 raft_consensus.cc:3037] T 723969ccd114427893218ff642633ff4 P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:57.774981 22987 raft_consensus.cc:504] T 723969ccd114427893218ff642633ff4 P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:57.776629 22987 leader_election.cc:288] T 723969ccd114427893218ff642633ff4 P d356524433a542328c096746bed5abef [CANDIDATE]: Term 2 election: Requested vote from peers ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693), cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489)
I20260807 13:39:57.777691 22780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "723969ccd114427893218ff642633ff4" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
I20260807 13:39:57.777985 22884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "723969ccd114427893218ff642633ff4" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
I20260807 13:39:57.778301 22780 raft_consensus.cc:3032] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:39:57.778592 22884 raft_consensus.cc:3037] T 723969ccd114427893218ff642633ff4 P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:57.778713 22780 raft_consensus.cc:729] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Running, Role: LEADER
I20260807 13:39:57.779698 22780 consensus_queue.cc:260] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:57.780802 22780 raft_consensus.cc:3037] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:57.783975 22884 raft_consensus.cc:2454] T 723969ccd114427893218ff642633ff4 P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d356524433a542328c096746bed5abef in term 2.
I20260807 13:39:57.785194 22942 leader_election.cc:302] T 723969ccd114427893218ff642633ff4 P d356524433a542328c096746bed5abef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, d356524433a542328c096746bed5abef; no voters:
I20260807 13:39:57.785985 23141 raft_consensus.cc:2781] T 723969ccd114427893218ff642633ff4 P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:39:57.785995 22780 raft_consensus.cc:2454] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d356524433a542328c096746bed5abef in term 2.
I20260807 13:39:57.787484 23141 raft_consensus.cc:686] T 723969ccd114427893218ff642633ff4 P d356524433a542328c096746bed5abef [term 2 LEADER]: Becoming Leader. State: Replica: d356524433a542328c096746bed5abef, State: Running, Role: LEADER
I20260807 13:39:57.788481 23141 consensus_queue.cc:237] T 723969ccd114427893218ff642633ff4 P d356524433a542328c096746bed5abef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:57.795866 22635 catalog_manager.cc:5495] T 723969ccd114427893218ff642633ff4 P d356524433a542328c096746bed5abef reported cstate change: term changed from 1 to 2, leader changed from ce1db935895842f49ccbd894ab313d5c (127.21.82.65) to d356524433a542328c096746bed5abef (127.21.82.67). New cstate: current_term: 2 leader_uuid: "d356524433a542328c096746bed5abef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } health_report { overall_health: HEALTHY } } }
I20260807 13:39:57.801079 23200 raft_consensus.cc:979] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c: : Instructing follower cc4e4942424c4427931538dabfc6b63d to start an election
I20260807 13:39:57.801627 23200 raft_consensus.cc:1067] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 1 LEADER]: Signalling peer cc4e4942424c4427931538dabfc6b63d to start an election
I20260807 13:39:57.803424 22884 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a635ded89e9c481bbd9d31bcd04ed678"
dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
from {username='slave'} at 127.0.0.1:51376
I20260807 13:39:57.803960 22884 raft_consensus.cc:482] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:39:57.804330 22884 raft_consensus.cc:3037] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:57.809446 22884 raft_consensus.cc:504] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:57.811017 22884 leader_election.cc:288] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 2 election: Requested vote from peers ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693), d356524433a542328c096746bed5abef (127.21.82.67:36453)
I20260807 13:39:57.811985 22780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a635ded89e9c481bbd9d31bcd04ed678" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
I20260807 13:39:57.812139 22987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a635ded89e9c481bbd9d31bcd04ed678" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d356524433a542328c096746bed5abef"
I20260807 13:39:57.812654 22780 raft_consensus.cc:3032] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:39:57.812772 22987 raft_consensus.cc:3037] T a635ded89e9c481bbd9d31bcd04ed678 P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:57.812983 22780 raft_consensus.cc:729] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Running, Role: LEADER
I20260807 13:39:57.813774 22780 consensus_queue.cc:260] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:57.814620 22780 raft_consensus.cc:3037] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:57.817548 22987 raft_consensus.cc:2454] T a635ded89e9c481bbd9d31bcd04ed678 P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc4e4942424c4427931538dabfc6b63d in term 2.
I20260807 13:39:57.818159 22991 raft_consensus.cc:1226] T a635ded89e9c481bbd9d31bcd04ed678 P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Rejecting Update request from peer ce1db935895842f49ccbd894ab313d5c for earlier term 1. Current term is 2. Ops: []
I20260807 13:39:57.818845 22835 leader_election.cc:302] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, d356524433a542328c096746bed5abef; no voters:
I20260807 13:39:57.819751 23123 raft_consensus.cc:2781] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:39:57.820068 22780 raft_consensus.cc:2454] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc4e4942424c4427931538dabfc6b63d in term 2.
I20260807 13:39:57.820238 23123 raft_consensus.cc:686] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [term 2 LEADER]: Becoming Leader. State: Replica: cc4e4942424c4427931538dabfc6b63d, State: Running, Role: LEADER
I20260807 13:39:57.821163 23123 consensus_queue.cc:237] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:57.828859 22635 catalog_manager.cc:5495] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d reported cstate change: term changed from 1 to 2, leader changed from ce1db935895842f49ccbd894ab313d5c (127.21.82.65) to cc4e4942424c4427931538dabfc6b63d (127.21.82.66). New cstate: current_term: 2 leader_uuid: "cc4e4942424c4427931538dabfc6b63d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:57.858841 23188 raft_consensus.cc:979] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d: : Instructing follower ce1db935895842f49ccbd894ab313d5c to start an election
I20260807 13:39:57.859301 23123 raft_consensus.cc:1067] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [term 1 LEADER]: Signalling peer ce1db935895842f49ccbd894ab313d5c to start an election
I20260807 13:39:57.860836 22780 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e234587595554ae183f5b9604ba1c0b9"
dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
from {username='slave'} at 127.0.0.1:53372
I20260807 13:39:57.861348 22780 raft_consensus.cc:482] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:39:57.861670 22780 raft_consensus.cc:3037] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:57.866801 22780 raft_consensus.cc:504] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } }
I20260807 13:39:57.868403 22780 leader_election.cc:288] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 2 election: Requested vote from peers d356524433a542328c096746bed5abef (127.21.82.67:36453), cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489)
I20260807 13:39:57.869531 22884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e234587595554ae183f5b9604ba1c0b9" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
I20260807 13:39:57.869529 22991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e234587595554ae183f5b9604ba1c0b9" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d356524433a542328c096746bed5abef"
I20260807 13:39:57.870337 22884 raft_consensus.cc:3032] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:39:57.870440 22991 raft_consensus.cc:3037] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:57.870702 22884 raft_consensus.cc:729] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc4e4942424c4427931538dabfc6b63d, State: Running, Role: LEADER
I20260807 13:39:57.871556 22884 consensus_queue.cc:260] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } }
I20260807 13:39:57.872529 22884 raft_consensus.cc:3037] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:57.875471 22991 raft_consensus.cc:2454] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce1db935895842f49ccbd894ab313d5c in term 2.
I20260807 13:39:57.876513 22736 leader_election.cc:302] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce1db935895842f49ccbd894ab313d5c, d356524433a542328c096746bed5abef; no voters:
I20260807 13:39:57.877331 23200 raft_consensus.cc:2781] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:39:57.877570 22884 raft_consensus.cc:2454] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce1db935895842f49ccbd894ab313d5c in term 2.
I20260807 13:39:57.877856 23200 raft_consensus.cc:686] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [term 2 LEADER]: Becoming Leader. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Running, Role: LEADER
I20260807 13:39:57.878748 23200 consensus_queue.cc:237] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } }
I20260807 13:39:57.885915 22635 catalog_manager.cc:5495] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c reported cstate change: term changed from 1 to 2, leader changed from cc4e4942424c4427931538dabfc6b63d (127.21.82.66) to ce1db935895842f49ccbd894ab313d5c (127.21.82.65). New cstate: current_term: 2 leader_uuid: "ce1db935895842f49ccbd894ab313d5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } health_report { overall_health: HEALTHY } } }
I20260807 13:39:58.053829 23188 raft_consensus.cc:979] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d: : Instructing follower ce1db935895842f49ccbd894ab313d5c to start an election
I20260807 13:39:58.054319 23123 raft_consensus.cc:1067] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [term 1 LEADER]: Signalling peer ce1db935895842f49ccbd894ab313d5c to start an election
I20260807 13:39:58.055792 22780 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "124b47385de445e08109ad645d366881"
dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
from {username='slave'} at 127.0.0.1:53372
I20260807 13:39:58.056308 22780 raft_consensus.cc:482] T 124b47385de445e08109ad645d366881 P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:39:58.056636 22780 raft_consensus.cc:3037] T 124b47385de445e08109ad645d366881 P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:58.061365 22780 raft_consensus.cc:504] T 124b47385de445e08109ad645d366881 P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:58.063005 22780 leader_election.cc:288] T 124b47385de445e08109ad645d366881 P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 2 election: Requested vote from peers cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489), d356524433a542328c096746bed5abef (127.21.82.67:36453)
I20260807 13:39:58.063884 22884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "124b47385de445e08109ad645d366881" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
I20260807 13:39:58.064502 22884 raft_consensus.cc:3032] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:39:58.064685 22991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "124b47385de445e08109ad645d366881" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d356524433a542328c096746bed5abef"
I20260807 13:39:58.064882 22884 raft_consensus.cc:729] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc4e4942424c4427931538dabfc6b63d, State: Running, Role: LEADER
I20260807 13:39:58.065299 22991 raft_consensus.cc:3037] T 124b47385de445e08109ad645d366881 P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:58.065714 22884 consensus_queue.cc:260] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:58.067013 22884 raft_consensus.cc:3037] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:58.072160 22991 raft_consensus.cc:2454] T 124b47385de445e08109ad645d366881 P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce1db935895842f49ccbd894ab313d5c in term 2.
I20260807 13:39:58.073350 22736 leader_election.cc:302] T 124b47385de445e08109ad645d366881 P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce1db935895842f49ccbd894ab313d5c, d356524433a542328c096746bed5abef; no voters:
I20260807 13:39:58.073556 22884 raft_consensus.cc:2454] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce1db935895842f49ccbd894ab313d5c in term 2.
I20260807 13:39:58.074162 23200 raft_consensus.cc:2781] T 124b47385de445e08109ad645d366881 P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:39:58.074682 23200 raft_consensus.cc:686] T 124b47385de445e08109ad645d366881 P ce1db935895842f49ccbd894ab313d5c [term 2 LEADER]: Becoming Leader. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Running, Role: LEADER
I20260807 13:39:58.075522 23200 consensus_queue.cc:237] T 124b47385de445e08109ad645d366881 P ce1db935895842f49ccbd894ab313d5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:58.082371 22635 catalog_manager.cc:5495] T 124b47385de445e08109ad645d366881 P ce1db935895842f49ccbd894ab313d5c reported cstate change: term changed from 1 to 2, leader changed from cc4e4942424c4427931538dabfc6b63d (127.21.82.66) to ce1db935895842f49ccbd894ab313d5c (127.21.82.65). New cstate: current_term: 2 leader_uuid: "ce1db935895842f49ccbd894ab313d5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:58.107493 23201 raft_consensus.cc:979] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef: : Instructing follower ce1db935895842f49ccbd894ab313d5c to start an election
I20260807 13:39:58.107991 23201 raft_consensus.cc:1067] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [term 1 LEADER]: Signalling peer ce1db935895842f49ccbd894ab313d5c to start an election
I20260807 13:39:58.108026 22780 raft_consensus.cc:1261] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Refusing update from remote peer cc4e4942424c4427931538dabfc6b63d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260807 13:39:58.109390 23123 consensus_queue.cc:1035] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:39:58.109681 22780 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "507d17016e0d4daaa005e6cef4e44bbe"
dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
from {username='slave'} at 127.0.0.1:53368
I20260807 13:39:58.110242 22780 raft_consensus.cc:482] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:39:58.110572 22780 raft_consensus.cc:3037] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:58.117245 22780 raft_consensus.cc:504] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:58.119916 22884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507d17016e0d4daaa005e6cef4e44bbe" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
I20260807 13:39:58.120473 22884 raft_consensus.cc:3037] T 507d17016e0d4daaa005e6cef4e44bbe P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:58.123739 22991 raft_consensus.cc:1261] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Refusing update from remote peer cc4e4942424c4427931538dabfc6b63d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260807 13:39:58.124445 22987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507d17016e0d4daaa005e6cef4e44bbe" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d356524433a542328c096746bed5abef"
I20260807 13:39:58.125037 22987 raft_consensus.cc:3032] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:39:58.125346 22987 raft_consensus.cc:729] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d356524433a542328c096746bed5abef, State: Running, Role: LEADER
I20260807 13:39:58.125339 23123 consensus_queue.cc:1035] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:39:58.126300 22987 consensus_queue.cc:260] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:58.127831 22987 raft_consensus.cc:3037] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:58.134955 22987 raft_consensus.cc:2454] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce1db935895842f49ccbd894ab313d5c in term 2.
I20260807 13:39:58.135699 22780 leader_election.cc:288] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 2 election: Requested vote from peers cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489), d356524433a542328c096746bed5abef (127.21.82.67:36453)
I20260807 13:39:58.135999 22736 leader_election.cc:302] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce1db935895842f49ccbd894ab313d5c, d356524433a542328c096746bed5abef; no voters:
I20260807 13:39:58.136849 23200 raft_consensus.cc:2781] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:39:58.137301 23200 raft_consensus.cc:686] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [term 2 LEADER]: Becoming Leader. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Running, Role: LEADER
I20260807 13:39:58.137988 23200 consensus_queue.cc:237] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:58.141207 22884 raft_consensus.cc:2454] T 507d17016e0d4daaa005e6cef4e44bbe P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce1db935895842f49ccbd894ab313d5c in term 2.
I20260807 13:39:58.145612 22637 catalog_manager.cc:5495] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c reported cstate change: term changed from 1 to 2, leader changed from d356524433a542328c096746bed5abef (127.21.82.67) to ce1db935895842f49ccbd894ab313d5c (127.21.82.65). New cstate: current_term: 2 leader_uuid: "ce1db935895842f49ccbd894ab313d5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:58.151067 23201 raft_consensus.cc:979] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef: : Instructing follower ce1db935895842f49ccbd894ab313d5c to start an election
I20260807 13:39:58.151538 23141 raft_consensus.cc:1067] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [term 1 LEADER]: Signalling peer ce1db935895842f49ccbd894ab313d5c to start an election
I20260807 13:39:58.153117 22780 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b81bed43b6aa4d64953c7bd3b5f10d3c"
dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
from {username='slave'} at 127.0.0.1:53368
I20260807 13:39:58.153677 22780 raft_consensus.cc:482] T b81bed43b6aa4d64953c7bd3b5f10d3c P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:39:58.154067 22780 raft_consensus.cc:3037] T b81bed43b6aa4d64953c7bd3b5f10d3c P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:58.158928 22780 raft_consensus.cc:504] T b81bed43b6aa4d64953c7bd3b5f10d3c P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:58.160706 22780 leader_election.cc:288] T b81bed43b6aa4d64953c7bd3b5f10d3c P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 2 election: Requested vote from peers cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489), d356524433a542328c096746bed5abef (127.21.82.67:36453)
I20260807 13:39:58.161612 22884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b81bed43b6aa4d64953c7bd3b5f10d3c" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
I20260807 13:39:58.161697 22987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b81bed43b6aa4d64953c7bd3b5f10d3c" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d356524433a542328c096746bed5abef"
I20260807 13:39:58.162218 22884 raft_consensus.cc:3037] T b81bed43b6aa4d64953c7bd3b5f10d3c P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:58.162257 22987 raft_consensus.cc:3032] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:39:58.162704 22987 raft_consensus.cc:729] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d356524433a542328c096746bed5abef, State: Running, Role: LEADER
I20260807 13:39:58.163538 22987 consensus_queue.cc:260] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:58.164749 22987 raft_consensus.cc:3037] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:58.167484 22884 raft_consensus.cc:2454] T b81bed43b6aa4d64953c7bd3b5f10d3c P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce1db935895842f49ccbd894ab313d5c in term 2.
I20260807 13:39:58.168473 22738 leader_election.cc:302] T b81bed43b6aa4d64953c7bd3b5f10d3c P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, ce1db935895842f49ccbd894ab313d5c; no voters:
I20260807 13:39:58.169173 23200 raft_consensus.cc:2781] T b81bed43b6aa4d64953c7bd3b5f10d3c P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:39:58.169550 23200 raft_consensus.cc:686] T b81bed43b6aa4d64953c7bd3b5f10d3c P ce1db935895842f49ccbd894ab313d5c [term 2 LEADER]: Becoming Leader. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Running, Role: LEADER
I20260807 13:39:58.169660 22987 raft_consensus.cc:2454] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce1db935895842f49ccbd894ab313d5c in term 2.
I20260807 13:39:58.170317 23200 consensus_queue.cc:237] T b81bed43b6aa4d64953c7bd3b5f10d3c P ce1db935895842f49ccbd894ab313d5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:58.177268 22637 catalog_manager.cc:5495] T b81bed43b6aa4d64953c7bd3b5f10d3c P ce1db935895842f49ccbd894ab313d5c reported cstate change: term changed from 1 to 2, leader changed from d356524433a542328c096746bed5abef (127.21.82.67) to ce1db935895842f49ccbd894ab313d5c (127.21.82.65). New cstate: current_term: 2 leader_uuid: "ce1db935895842f49ccbd894ab313d5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:58.201318 23201 raft_consensus.cc:979] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef: : Instructing follower cc4e4942424c4427931538dabfc6b63d to start an election
I20260807 13:39:58.201812 23141 raft_consensus.cc:1067] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [term 1 LEADER]: Signalling peer cc4e4942424c4427931538dabfc6b63d to start an election
I20260807 13:39:58.203203 22884 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "69f0e9ea6b784ea89a5cb1fcc5a0293e"
dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
from {username='slave'} at 127.0.0.1:51374
I20260807 13:39:58.203706 22884 raft_consensus.cc:482] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:39:58.204013 22884 raft_consensus.cc:3037] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:58.208704 22884 raft_consensus.cc:504] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:58.210246 22884 leader_election.cc:288] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 2 election: Requested vote from peers ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693), d356524433a542328c096746bed5abef (127.21.82.67:36453)
I20260807 13:39:58.211328 22780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69f0e9ea6b784ea89a5cb1fcc5a0293e" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
I20260807 13:39:58.211406 22987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69f0e9ea6b784ea89a5cb1fcc5a0293e" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d356524433a542328c096746bed5abef"
I20260807 13:39:58.211911 22780 raft_consensus.cc:3037] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:58.211958 22987 raft_consensus.cc:3032] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:39:58.212339 22987 raft_consensus.cc:729] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d356524433a542328c096746bed5abef, State: Running, Role: LEADER
I20260807 13:39:58.212965 22987 consensus_queue.cc:260] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:58.213940 22987 raft_consensus.cc:3037] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:58.216624 22780 raft_consensus.cc:2454] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc4e4942424c4427931538dabfc6b63d in term 2.
I20260807 13:39:58.217547 22837 leader_election.cc:302] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, ce1db935895842f49ccbd894ab313d5c; no voters:
I20260807 13:39:58.218264 23123 raft_consensus.cc:2781] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:39:58.218757 23123 raft_consensus.cc:686] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d [term 2 LEADER]: Becoming Leader. State: Replica: cc4e4942424c4427931538dabfc6b63d, State: Running, Role: LEADER
I20260807 13:39:58.219152 22987 raft_consensus.cc:2454] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc4e4942424c4427931538dabfc6b63d in term 2.
I20260807 13:39:58.219630 23123 consensus_queue.cc:237] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:39:58.227082 22637 catalog_manager.cc:5495] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d reported cstate change: term changed from 1 to 2, leader changed from d356524433a542328c096746bed5abef (127.21.82.67) to cc4e4942424c4427931538dabfc6b63d (127.21.82.66). New cstate: current_term: 2 leader_uuid: "cc4e4942424c4427931538dabfc6b63d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:58.269902 22987 raft_consensus.cc:1261] T a635ded89e9c481bbd9d31bcd04ed678 P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Refusing update from remote peer cc4e4942424c4427931538dabfc6b63d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:58.271265 23123 consensus_queue.cc:1035] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:58.280959 22780 raft_consensus.cc:1261] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Refusing update from remote peer cc4e4942424c4427931538dabfc6b63d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:58.282522 23223 consensus_queue.cc:1035] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:58.394423 22987 raft_consensus.cc:1261] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Refusing update from remote peer ce1db935895842f49ccbd894ab313d5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:58.395669 23200 consensus_queue.cc:1035] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:58.397346 22780 raft_consensus.cc:1261] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Refusing update from remote peer d356524433a542328c096746bed5abef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:58.398898 23141 consensus_queue.cc:1035] T 723969ccd114427893218ff642633ff4 P d356524433a542328c096746bed5abef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:39:58.406032 22884 raft_consensus.cc:1261] T 723969ccd114427893218ff642633ff4 P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Refusing update from remote peer d356524433a542328c096746bed5abef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:58.406759 22881 raft_consensus.cc:1261] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Refusing update from remote peer ce1db935895842f49ccbd894ab313d5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:58.408313 23141 consensus_queue.cc:1035] T 723969ccd114427893218ff642633ff4 P d356524433a542328c096746bed5abef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:58.408515 23228 consensus_queue.cc:1035] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:58.544358 22884 raft_consensus.cc:1261] T 507d17016e0d4daaa005e6cef4e44bbe P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Refusing update from remote peer ce1db935895842f49ccbd894ab313d5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:58.545686 23228 consensus_queue.cc:1035] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:58.554912 22987 raft_consensus.cc:1261] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Refusing update from remote peer ce1db935895842f49ccbd894ab313d5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:58.556735 23228 consensus_queue.cc:1035] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:58.635349 22884 raft_consensus.cc:1261] T b81bed43b6aa4d64953c7bd3b5f10d3c P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Refusing update from remote peer ce1db935895842f49ccbd894ab313d5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:58.636675 23200 consensus_queue.cc:1035] T b81bed43b6aa4d64953c7bd3b5f10d3c P ce1db935895842f49ccbd894ab313d5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:58.638609 22987 raft_consensus.cc:1261] T 124b47385de445e08109ad645d366881 P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Refusing update from remote peer ce1db935895842f49ccbd894ab313d5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:58.639895 23200 consensus_queue.cc:1035] T 124b47385de445e08109ad645d366881 P ce1db935895842f49ccbd894ab313d5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:58.647670 22987 raft_consensus.cc:1261] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Refusing update from remote peer ce1db935895842f49ccbd894ab313d5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:58.649032 23228 consensus_queue.cc:1035] T b81bed43b6aa4d64953c7bd3b5f10d3c P ce1db935895842f49ccbd894ab313d5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:58.655758 22881 raft_consensus.cc:1261] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Refusing update from remote peer ce1db935895842f49ccbd894ab313d5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:58.657449 23228 consensus_queue.cc:1035] T 124b47385de445e08109ad645d366881 P ce1db935895842f49ccbd894ab313d5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:58.708523 22780 raft_consensus.cc:1261] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Refusing update from remote peer cc4e4942424c4427931538dabfc6b63d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:58.710202 23223 consensus_queue.cc:1035] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:39:58.720304 22987 raft_consensus.cc:1261] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Refusing update from remote peer cc4e4942424c4427931538dabfc6b63d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:58.721860 23223 consensus_queue.cc:1035] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:00.786840 21833 auto_leader_rebalancer-test.cc:339] The leader distribution is
I20260807 13:40:00.787743 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:40:00.814883 22780 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c9bbe03a111e4a43a9bc12b726d2748e"
dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
mode: GRACEFUL
new_leader_uuid: "d356524433a542328c096746bed5abef"
from {username='slave'} at 127.0.0.1:53452
I20260807 13:40:00.815624 22780 raft_consensus.cc:595] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [term 1 LEADER]: Received request to transfer leadership to TS d356524433a542328c096746bed5abef
I20260807 13:40:00.818054 22780 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e234587595554ae183f5b9604ba1c0b9"
dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
mode: GRACEFUL
new_leader_uuid: "d356524433a542328c096746bed5abef"
from {username='slave'} at 127.0.0.1:53452
I20260807 13:40:00.818595 22780 raft_consensus.cc:595] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [term 2 LEADER]: Received request to transfer leadership to TS d356524433a542328c096746bed5abef
I20260807 13:40:00.819662 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260807 13:40:00.820122 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:40:00.876957 23118 raft_consensus.cc:979] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c: : Instructing follower d356524433a542328c096746bed5abef to start an election
I20260807 13:40:00.877566 23257 raft_consensus.cc:1067] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [term 2 LEADER]: Signalling peer d356524433a542328c096746bed5abef to start an election
I20260807 13:40:00.879249 22987 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e234587595554ae183f5b9604ba1c0b9"
dest_uuid: "d356524433a542328c096746bed5abef"
from {username='slave'} at 127.0.0.1:39240
I20260807 13:40:00.879817 22987 raft_consensus.cc:482] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:40:00.880164 22987 raft_consensus.cc:3037] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:00.886826 22987 raft_consensus.cc:504] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } }
I20260807 13:40:00.888753 22987 leader_election.cc:288] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [CANDIDATE]: Term 3 election: Requested vote from peers cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489), ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693)
I20260807 13:40:00.890113 22780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e234587595554ae183f5b9604ba1c0b9" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
I20260807 13:40:00.890084 22881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e234587595554ae183f5b9604ba1c0b9" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
I20260807 13:40:00.890865 22780 raft_consensus.cc:3032] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:00.890985 22881 raft_consensus.cc:3037] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:00.891170 22780 raft_consensus.cc:729] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Running, Role: LEADER
I20260807 13:40:00.891984 22780 consensus_queue.cc:260] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } }
I20260807 13:40:00.893165 22780 raft_consensus.cc:3037] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:00.896803 22881 raft_consensus.cc:2454] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d356524433a542328c096746bed5abef in term 3.
I20260807 13:40:00.898151 22942 leader_election.cc:302] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, d356524433a542328c096746bed5abef; no voters:
I20260807 13:40:00.898636 22780 raft_consensus.cc:2454] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d356524433a542328c096746bed5abef in term 3.
I20260807 13:40:00.899134 23141 raft_consensus.cc:2781] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:00.900471 23141 raft_consensus.cc:686] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [term 3 LEADER]: Becoming Leader. State: Replica: d356524433a542328c096746bed5abef, State: Running, Role: LEADER
I20260807 13:40:00.901328 23141 consensus_queue.cc:237] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } }
I20260807 13:40:00.909639 22636 catalog_manager.cc:5495] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef reported cstate change: term changed from 2 to 3, leader changed from ce1db935895842f49ccbd894ab313d5c (127.21.82.65) to d356524433a542328c096746bed5abef (127.21.82.67). New cstate: current_term: 3 leader_uuid: "d356524433a542328c096746bed5abef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:01.190255 23118 raft_consensus.cc:979] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c: : Instructing follower d356524433a542328c096746bed5abef to start an election
I20260807 13:40:01.190809 23118 raft_consensus.cc:1067] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [term 1 LEADER]: Signalling peer d356524433a542328c096746bed5abef to start an election
I20260807 13:40:01.192234 22987 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c9bbe03a111e4a43a9bc12b726d2748e"
dest_uuid: "d356524433a542328c096746bed5abef"
from {username='slave'} at 127.0.0.1:39240
I20260807 13:40:01.192785 22987 raft_consensus.cc:482] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:40:01.193089 22987 raft_consensus.cc:3037] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:01.198256 22987 raft_consensus.cc:504] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:40:01.200115 22987 leader_election.cc:288] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [CANDIDATE]: Term 2 election: Requested vote from peers ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693), cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489)
I20260807 13:40:01.200817 22780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9bbe03a111e4a43a9bc12b726d2748e" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
I20260807 13:40:01.201227 22881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9bbe03a111e4a43a9bc12b726d2748e" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
I20260807 13:40:01.201498 22780 raft_consensus.cc:3032] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:01.201797 22780 raft_consensus.cc:729] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Running, Role: LEADER
I20260807 13:40:01.201874 22881 raft_consensus.cc:3037] T c9bbe03a111e4a43a9bc12b726d2748e P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:01.202484 22780 consensus_queue.cc:260] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:40:01.203552 22780 raft_consensus.cc:3037] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:01.209883 22780 raft_consensus.cc:2454] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d356524433a542328c096746bed5abef in term 2.
I20260807 13:40:01.211207 22942 leader_election.cc:302] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce1db935895842f49ccbd894ab313d5c, d356524433a542328c096746bed5abef; no voters:
I20260807 13:40:01.211485 22881 raft_consensus.cc:2454] T c9bbe03a111e4a43a9bc12b726d2748e P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d356524433a542328c096746bed5abef in term 2.
I20260807 13:40:01.212152 23141 raft_consensus.cc:2781] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:01.212695 23141 raft_consensus.cc:686] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [term 2 LEADER]: Becoming Leader. State: Replica: d356524433a542328c096746bed5abef, State: Running, Role: LEADER
I20260807 13:40:01.213575 23141 consensus_queue.cc:237] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:40:01.221720 22636 catalog_manager.cc:5495] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef reported cstate change: term changed from 1 to 2, leader changed from ce1db935895842f49ccbd894ab313d5c (127.21.82.65) to d356524433a542328c096746bed5abef (127.21.82.67). New cstate: current_term: 2 leader_uuid: "d356524433a542328c096746bed5abef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:01.352447 22881 raft_consensus.cc:1261] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [term 3 FOLLOWER]: Refusing update from remote peer d356524433a542328c096746bed5abef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:40:01.353814 23141 consensus_queue.cc:1035] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:40:01.367997 22780 raft_consensus.cc:1261] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [term 3 FOLLOWER]: Refusing update from remote peer d356524433a542328c096746bed5abef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:40:01.369478 23259 consensus_queue.cc:1035] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:40:01.631028 22881 raft_consensus.cc:1261] T c9bbe03a111e4a43a9bc12b726d2748e P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Refusing update from remote peer d356524433a542328c096746bed5abef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:01.632450 23141 consensus_queue.cc:1035] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:01.641885 22780 raft_consensus.cc:1261] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Refusing update from remote peer d356524433a542328c096746bed5abef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:01.643689 23141 consensus_queue.cc:1035] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:01.821036 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:40:01.826426 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:40:01.827011 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:40:02.828035 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:40:02.834147 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:40:02.834614 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:40:03.835572 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:40:03.841323 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:40:03.841770 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:40:04.842799 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:40:04.847963 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:40:04.848460 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:40:05.849351 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:40:05.854519 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:40:05.855114 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:40:06.856000 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:40:06.861337 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:40:06.861900 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:40:07.862898 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:40:07.868548 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:40:07.868947 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:40:08.869863 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:40:08.875998 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:40:08.876576 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:40:09.877427 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:40:09.882687 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:40:09.883179 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:40:10.918956 21833 auto_leader_rebalancer-test.cc:358] The leader distribution is
I20260807 13:40:10.924978 22987 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e234587595554ae183f5b9604ba1c0b9"
dest_uuid: "d356524433a542328c096746bed5abef"
mode: GRACEFUL
new_leader_uuid: "ce1db935895842f49ccbd894ab313d5c"
from {username='slave'} at 127.0.0.1:39244
I20260807 13:40:10.926033 22987 raft_consensus.cc:595] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [term 3 LEADER]: Received request to transfer leadership to TS ce1db935895842f49ccbd894ab313d5c
I20260807 13:40:10.940366 22987 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c9bbe03a111e4a43a9bc12b726d2748e"
dest_uuid: "d356524433a542328c096746bed5abef"
mode: GRACEFUL
new_leader_uuid: "ce1db935895842f49ccbd894ab313d5c"
from {username='slave'} at 127.0.0.1:39244
I20260807 13:40:10.940929 22987 raft_consensus.cc:595] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [term 2 LEADER]: Received request to transfer leadership to TS ce1db935895842f49ccbd894ab313d5c
I20260807 13:40:10.947048 22884 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d10115b832134c989a9752a1626893e6"
dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
mode: GRACEFUL
new_leader_uuid: "ce1db935895842f49ccbd894ab313d5c"
from {username='slave'} at 127.0.0.1:51378
I20260807 13:40:10.947723 22884 raft_consensus.cc:595] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [term 1 LEADER]: Received request to transfer leadership to TS ce1db935895842f49ccbd894ab313d5c
I20260807 13:40:10.953047 22884 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a635ded89e9c481bbd9d31bcd04ed678"
dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
mode: GRACEFUL
new_leader_uuid: "ce1db935895842f49ccbd894ab313d5c"
from {username='slave'} at 127.0.0.1:51378
I20260807 13:40:10.953631 22884 raft_consensus.cc:595] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [term 2 LEADER]: Received request to transfer leadership to TS ce1db935895842f49ccbd894ab313d5c
I20260807 13:40:10.959124 22884 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a5872d5bc74e4657867e0d2cafb86ad6"
dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
mode: GRACEFUL
new_leader_uuid: "ce1db935895842f49ccbd894ab313d5c"
from {username='slave'} at 127.0.0.1:51378
I20260807 13:40:10.959728 22884 raft_consensus.cc:595] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 2 LEADER]: Received request to transfer leadership to TS ce1db935895842f49ccbd894ab313d5c
I20260807 13:40:10.991318 23293 raft_consensus.cc:979] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef: : Instructing follower ce1db935895842f49ccbd894ab313d5c to start an election
I20260807 13:40:10.992630 23293 raft_consensus.cc:1067] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [term 3 LEADER]: Signalling peer ce1db935895842f49ccbd894ab313d5c to start an election
I20260807 13:40:10.994566 22781 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e234587595554ae183f5b9604ba1c0b9"
dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
from {username='slave'} at 127.0.0.1:53368
I20260807 13:40:10.995265 22781 raft_consensus.cc:482] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:40:10.995672 22781 raft_consensus.cc:3037] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:11.002502 22781 raft_consensus.cc:504] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } }
I20260807 13:40:11.005296 22781 leader_election.cc:288] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 4 election: Requested vote from peers d356524433a542328c096746bed5abef (127.21.82.67:36453), cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489)
I20260807 13:40:11.006505 22987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e234587595554ae183f5b9604ba1c0b9" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d356524433a542328c096746bed5abef"
I20260807 13:40:11.007467 22987 raft_consensus.cc:3032] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:40:11.006619 22884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e234587595554ae183f5b9604ba1c0b9" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
I20260807 13:40:11.007768 22987 raft_consensus.cc:729] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d356524433a542328c096746bed5abef, State: Running, Role: LEADER
I20260807 13:40:11.008170 22884 raft_consensus.cc:3037] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:11.008704 22987 consensus_queue.cc:260] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } }
I20260807 13:40:11.010035 22987 raft_consensus.cc:3037] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:11.014096 22884 raft_consensus.cc:2454] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce1db935895842f49ccbd894ab313d5c in term 4.
I20260807 13:40:11.014963 22881 raft_consensus.cc:1226] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [term 4 FOLLOWER]: Rejecting Update request from peer d356524433a542328c096746bed5abef for earlier term 3. Current term is 4. Ops: []
I20260807 13:40:11.015762 22738 leader_election.cc:302] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, ce1db935895842f49ccbd894ab313d5c; no voters:
I20260807 13:40:11.016415 22987 raft_consensus.cc:2454] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce1db935895842f49ccbd894ab313d5c in term 4.
I20260807 13:40:11.017019 23288 raft_consensus.cc:2781] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:40:11.018227 23288 raft_consensus.cc:686] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [term 4 LEADER]: Becoming Leader. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Running, Role: LEADER
I20260807 13:40:11.019148 23288 consensus_queue.cc:237] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } }
I20260807 13:40:11.027012 22636 catalog_manager.cc:5495] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c reported cstate change: term changed from 3 to 4, leader changed from d356524433a542328c096746bed5abef (127.21.82.67) to ce1db935895842f49ccbd894ab313d5c (127.21.82.65). New cstate: current_term: 4 leader_uuid: "ce1db935895842f49ccbd894ab313d5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:11.277976 23279 raft_consensus.cc:979] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef: : Instructing follower ce1db935895842f49ccbd894ab313d5c to start an election
I20260807 13:40:11.278501 23293 raft_consensus.cc:1067] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [term 2 LEADER]: Signalling peer ce1db935895842f49ccbd894ab313d5c to start an election
I20260807 13:40:11.280464 22781 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c9bbe03a111e4a43a9bc12b726d2748e"
dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
from {username='slave'} at 127.0.0.1:53368
I20260807 13:40:11.281198 22781 raft_consensus.cc:482] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:40:11.281677 22781 raft_consensus.cc:3037] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:11.290479 22781 raft_consensus.cc:504] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:40:11.293375 22781 leader_election.cc:288] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 3 election: Requested vote from peers cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489), d356524433a542328c096746bed5abef (127.21.82.67:36453)
I20260807 13:40:11.294836 22987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9bbe03a111e4a43a9bc12b726d2748e" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d356524433a542328c096746bed5abef"
I20260807 13:40:11.295136 22881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9bbe03a111e4a43a9bc12b726d2748e" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
I20260807 13:40:11.295665 22987 raft_consensus.cc:3032] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:11.296008 22987 raft_consensus.cc:729] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d356524433a542328c096746bed5abef, State: Running, Role: LEADER
I20260807 13:40:11.295977 22881 raft_consensus.cc:3037] T c9bbe03a111e4a43a9bc12b726d2748e P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:11.297057 22987 consensus_queue.cc:260] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:40:11.298650 22987 raft_consensus.cc:3037] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:11.307483 22987 raft_consensus.cc:2454] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce1db935895842f49ccbd894ab313d5c in term 3.
I20260807 13:40:11.308547 22881 raft_consensus.cc:2454] T c9bbe03a111e4a43a9bc12b726d2748e P cc4e4942424c4427931538dabfc6b63d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce1db935895842f49ccbd894ab313d5c in term 3.
I20260807 13:40:11.309645 22736 leader_election.cc:302] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce1db935895842f49ccbd894ab313d5c, d356524433a542328c096746bed5abef; no voters:
I20260807 13:40:11.310845 23288 raft_consensus.cc:2781] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:11.311336 23288 raft_consensus.cc:686] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [term 3 LEADER]: Becoming Leader. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Running, Role: LEADER
I20260807 13:40:11.312879 23288 consensus_queue.cc:237] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:40:11.323035 22636 catalog_manager.cc:5495] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c reported cstate change: term changed from 2 to 3, leader changed from d356524433a542328c096746bed5abef (127.21.82.67) to ce1db935895842f49ccbd894ab313d5c (127.21.82.65). New cstate: current_term: 3 leader_uuid: "ce1db935895842f49ccbd894ab313d5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:11.328927 23278 raft_consensus.cc:979] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d: : Instructing follower ce1db935895842f49ccbd894ab313d5c to start an election
I20260807 13:40:11.329994 23305 raft_consensus.cc:1067] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [term 1 LEADER]: Signalling peer ce1db935895842f49ccbd894ab313d5c to start an election
I20260807 13:40:11.333815 22781 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d10115b832134c989a9752a1626893e6"
dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
from {username='slave'} at 127.0.0.1:53372
I20260807 13:40:11.334965 22781 raft_consensus.cc:482] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:40:11.335482 22781 raft_consensus.cc:3037] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:11.344178 22781 raft_consensus.cc:504] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:40:11.346575 22781 leader_election.cc:288] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 2 election: Requested vote from peers cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489), d356524433a542328c096746bed5abef (127.21.82.67:36453)
I20260807 13:40:11.347793 22987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d10115b832134c989a9752a1626893e6" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d356524433a542328c096746bed5abef"
I20260807 13:40:11.347837 22881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d10115b832134c989a9752a1626893e6" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
I20260807 13:40:11.348452 22987 raft_consensus.cc:3037] T d10115b832134c989a9752a1626893e6 P d356524433a542328c096746bed5abef [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:11.348906 22881 raft_consensus.cc:3032] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:11.349328 22881 raft_consensus.cc:729] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc4e4942424c4427931538dabfc6b63d, State: Running, Role: LEADER
I20260807 13:40:11.350286 22881 consensus_queue.cc:260] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:40:11.351929 22881 raft_consensus.cc:3037] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:11.353566 22987 raft_consensus.cc:2454] T d10115b832134c989a9752a1626893e6 P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce1db935895842f49ccbd894ab313d5c in term 2.
I20260807 13:40:11.354877 22736 leader_election.cc:302] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce1db935895842f49ccbd894ab313d5c, d356524433a542328c096746bed5abef; no voters:
I20260807 13:40:11.356173 23288 raft_consensus.cc:2781] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:11.356730 23288 raft_consensus.cc:686] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c [term 2 LEADER]: Becoming Leader. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Running, Role: LEADER
I20260807 13:40:11.357844 23288 consensus_queue.cc:237] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:40:11.360339 22881 raft_consensus.cc:2454] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce1db935895842f49ccbd894ab313d5c in term 2.
I20260807 13:40:11.368070 22636 catalog_manager.cc:5495] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c reported cstate change: term changed from 1 to 2, leader changed from cc4e4942424c4427931538dabfc6b63d (127.21.82.66) to ce1db935895842f49ccbd894ab313d5c (127.21.82.65). New cstate: current_term: 2 leader_uuid: "ce1db935895842f49ccbd894ab313d5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:11.389982 23278 raft_consensus.cc:979] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d: : Instructing follower ce1db935895842f49ccbd894ab313d5c to start an election
I20260807 13:40:11.390483 23305 raft_consensus.cc:1067] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 2 LEADER]: Signalling peer ce1db935895842f49ccbd894ab313d5c to start an election
I20260807 13:40:11.392617 22781 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a5872d5bc74e4657867e0d2cafb86ad6"
dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
from {username='slave'} at 127.0.0.1:53372
I20260807 13:40:11.393343 22781 raft_consensus.cc:482] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:40:11.393988 22781 raft_consensus.cc:3037] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:11.402148 22781 raft_consensus.cc:504] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:40:11.404966 22781 leader_election.cc:288] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 3 election: Requested vote from peers cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489), d356524433a542328c096746bed5abef (127.21.82.67:36453)
I20260807 13:40:11.406093 22881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5872d5bc74e4657867e0d2cafb86ad6" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
I20260807 13:40:11.406394 22987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5872d5bc74e4657867e0d2cafb86ad6" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "d356524433a542328c096746bed5abef"
I20260807 13:40:11.406909 22881 raft_consensus.cc:3032] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:11.407008 22987 raft_consensus.cc:3037] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:11.407300 22881 raft_consensus.cc:729] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cc4e4942424c4427931538dabfc6b63d, State: Running, Role: LEADER
I20260807 13:40:11.408351 22881 consensus_queue.cc:260] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:40:11.409945 22881 raft_consensus.cc:3037] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:11.412247 22987 raft_consensus.cc:2454] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce1db935895842f49ccbd894ab313d5c in term 3.
I20260807 13:40:11.413455 22736 leader_election.cc:302] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce1db935895842f49ccbd894ab313d5c, d356524433a542328c096746bed5abef; no voters:
I20260807 13:40:11.414357 23288 raft_consensus.cc:2781] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:11.415143 23288 raft_consensus.cc:686] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [term 3 LEADER]: Becoming Leader. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Running, Role: LEADER
I20260807 13:40:11.416421 23288 consensus_queue.cc:237] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:40:11.418026 22881 raft_consensus.cc:2454] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce1db935895842f49ccbd894ab313d5c in term 3.
I20260807 13:40:11.427040 22636 catalog_manager.cc:5495] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c reported cstate change: term changed from 2 to 3, leader changed from cc4e4942424c4427931538dabfc6b63d (127.21.82.66) to ce1db935895842f49ccbd894ab313d5c (127.21.82.65). New cstate: current_term: 3 leader_uuid: "ce1db935895842f49ccbd894ab313d5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:11.427793 23278 raft_consensus.cc:979] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d: : Instructing follower ce1db935895842f49ccbd894ab313d5c to start an election
I20260807 13:40:11.428366 23305 raft_consensus.cc:1067] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [term 2 LEADER]: Signalling peer ce1db935895842f49ccbd894ab313d5c to start an election
I20260807 13:40:11.430449 22781 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a635ded89e9c481bbd9d31bcd04ed678"
dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
from {username='slave'} at 127.0.0.1:53372
I20260807 13:40:11.431075 22781 raft_consensus.cc:482] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:40:11.431643 22781 raft_consensus.cc:3037] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:11.442441 22781 raft_consensus.cc:504] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:40:11.445374 22781 leader_election.cc:288] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 3 election: Requested vote from peers cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489), d356524433a542328c096746bed5abef (127.21.82.67:36453)
I20260807 13:40:11.446633 22987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a635ded89e9c481bbd9d31bcd04ed678" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d356524433a542328c096746bed5abef"
I20260807 13:40:11.446733 22881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a635ded89e9c481bbd9d31bcd04ed678" candidate_uuid: "ce1db935895842f49ccbd894ab313d5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
I20260807 13:40:11.447327 22987 raft_consensus.cc:3037] T a635ded89e9c481bbd9d31bcd04ed678 P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:11.447762 22881 raft_consensus.cc:3032] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:11.448179 22881 raft_consensus.cc:729] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cc4e4942424c4427931538dabfc6b63d, State: Running, Role: LEADER
I20260807 13:40:11.449376 22881 consensus_queue.cc:260] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:40:11.450634 22881 raft_consensus.cc:3037] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:11.452397 22987 raft_consensus.cc:2454] T a635ded89e9c481bbd9d31bcd04ed678 P d356524433a542328c096746bed5abef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce1db935895842f49ccbd894ab313d5c in term 3.
I20260807 13:40:11.453392 22736 leader_election.cc:302] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce1db935895842f49ccbd894ab313d5c, d356524433a542328c096746bed5abef; no voters:
I20260807 13:40:11.454377 23288 raft_consensus.cc:2781] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:11.455076 23288 raft_consensus.cc:686] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 3 LEADER]: Becoming Leader. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Running, Role: LEADER
I20260807 13:40:11.455662 22881 raft_consensus.cc:2454] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce1db935895842f49ccbd894ab313d5c in term 3.
I20260807 13:40:11.456699 23288 consensus_queue.cc:237] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:40:11.467213 22636 catalog_manager.cc:5495] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c reported cstate change: term changed from 2 to 3, leader changed from cc4e4942424c4427931538dabfc6b63d (127.21.82.66) to ce1db935895842f49ccbd894ab313d5c (127.21.82.65). New cstate: current_term: 3 leader_uuid: "ce1db935895842f49ccbd894ab313d5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:11.566573 22987 raft_consensus.cc:1261] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [term 4 FOLLOWER]: Refusing update from remote peer ce1db935895842f49ccbd894ab313d5c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 13:40:11.568112 23288 consensus_queue.cc:1035] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:40:11.610051 22881 raft_consensus.cc:1261] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [term 4 FOLLOWER]: Refusing update from remote peer ce1db935895842f49ccbd894ab313d5c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 13:40:11.612144 23318 consensus_queue.cc:1035] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:40:11.804201 22881 raft_consensus.cc:1261] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Refusing update from remote peer ce1db935895842f49ccbd894ab313d5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:11.805573 23318 consensus_queue.cc:1035] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:11.817152 22987 raft_consensus.cc:1261] T d10115b832134c989a9752a1626893e6 P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Refusing update from remote peer ce1db935895842f49ccbd894ab313d5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:11.818826 23318 consensus_queue.cc:1035] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:11.883409 22987 raft_consensus.cc:1261] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [term 3 FOLLOWER]: Refusing update from remote peer ce1db935895842f49ccbd894ab313d5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:40:11.884757 23318 consensus_queue.cc:1035] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:40:11.888998 22991 raft_consensus.cc:1261] T a635ded89e9c481bbd9d31bcd04ed678 P d356524433a542328c096746bed5abef [term 3 FOLLOWER]: Refusing update from remote peer ce1db935895842f49ccbd894ab313d5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:40:11.890812 23318 consensus_queue.cc:1035] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:40:11.898888 22881 raft_consensus.cc:1261] T c9bbe03a111e4a43a9bc12b726d2748e P cc4e4942424c4427931538dabfc6b63d [term 3 FOLLOWER]: Refusing update from remote peer ce1db935895842f49ccbd894ab313d5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:40:11.900552 23334 consensus_queue.cc:1035] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:40:11.911244 22884 raft_consensus.cc:1261] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 3 FOLLOWER]: Refusing update from remote peer ce1db935895842f49ccbd894ab313d5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:11.916043 22884 raft_consensus.cc:1261] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [term 3 FOLLOWER]: Refusing update from remote peer ce1db935895842f49ccbd894ab313d5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:40:11.916252 23320 consensus_queue.cc:1035] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:11.919363 23320 consensus_queue.cc:1035] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:40:11.930802 22991 raft_consensus.cc:1261] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [term 3 FOLLOWER]: Refusing update from remote peer ce1db935895842f49ccbd894ab313d5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:11.932461 23334 consensus_queue.cc:1035] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:13.996820 21833 auto_leader_rebalancer-test.cc:373] The leader distribution is
I20260807 13:40:13.997503 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:40:14.005117 22781 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "507d17016e0d4daaa005e6cef4e44bbe"
dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
mode: GRACEFUL
new_leader_uuid: "d356524433a542328c096746bed5abef"
from {username='slave'} at 127.0.0.1:53452
I20260807 13:40:14.005671 22781 raft_consensus.cc:595] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [term 2 LEADER]: Received request to transfer leadership to TS d356524433a542328c096746bed5abef
I20260807 13:40:14.008471 22781 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a5872d5bc74e4657867e0d2cafb86ad6"
dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
mode: GRACEFUL
new_leader_uuid: "cc4e4942424c4427931538dabfc6b63d"
from {username='slave'} at 127.0.0.1:53452
I20260807 13:40:14.009249 22781 raft_consensus.cc:595] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [term 3 LEADER]: Received request to transfer leadership to TS cc4e4942424c4427931538dabfc6b63d
I20260807 13:40:14.012902 22781 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a635ded89e9c481bbd9d31bcd04ed678"
dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
mode: GRACEFUL
new_leader_uuid: "cc4e4942424c4427931538dabfc6b63d"
from {username='slave'} at 127.0.0.1:53452
I20260807 13:40:14.013482 22781 raft_consensus.cc:595] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 3 LEADER]: Received request to transfer leadership to TS cc4e4942424c4427931538dabfc6b63d
I20260807 13:40:14.017535 22781 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d10115b832134c989a9752a1626893e6"
dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
mode: GRACEFUL
new_leader_uuid: "d356524433a542328c096746bed5abef"
from {username='slave'} at 127.0.0.1:53452
I20260807 13:40:14.018457 22781 raft_consensus.cc:595] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c [term 2 LEADER]: Received request to transfer leadership to TS d356524433a542328c096746bed5abef
I20260807 13:40:14.020185 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260807 13:40:14.020999 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:40:14.240926 23350 raft_consensus.cc:979] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c: : Instructing follower d356524433a542328c096746bed5abef to start an election
I20260807 13:40:14.242172 23349 raft_consensus.cc:1067] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [term 2 LEADER]: Signalling peer d356524433a542328c096746bed5abef to start an election
I20260807 13:40:14.244501 23340 raft_consensus.cc:979] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c: : Instructing follower cc4e4942424c4427931538dabfc6b63d to start an election
I20260807 13:40:14.245229 23349 raft_consensus.cc:1067] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 3 LEADER]: Signalling peer cc4e4942424c4427931538dabfc6b63d to start an election
I20260807 13:40:14.246572 22991 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "507d17016e0d4daaa005e6cef4e44bbe"
dest_uuid: "d356524433a542328c096746bed5abef"
from {username='slave'} at 127.0.0.1:39240
I20260807 13:40:14.247104 22881 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a635ded89e9c481bbd9d31bcd04ed678"
dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
from {username='slave'} at 127.0.0.1:51376
I20260807 13:40:14.247367 22991 raft_consensus.cc:482] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:40:14.247601 22881 raft_consensus.cc:482] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:40:14.247756 22991 raft_consensus.cc:3037] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:14.247961 22881 raft_consensus.cc:3037] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:14.250238 23350 raft_consensus.cc:979] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c: : Instructing follower cc4e4942424c4427931538dabfc6b63d to start an election
I20260807 13:40:14.251397 23349 raft_consensus.cc:1067] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [term 3 LEADER]: Signalling peer cc4e4942424c4427931538dabfc6b63d to start an election
I20260807 13:40:14.254905 22884 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a5872d5bc74e4657867e0d2cafb86ad6"
dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
from {username='slave'} at 127.0.0.1:51376
I20260807 13:40:14.256783 22884 raft_consensus.cc:482] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:40:14.257632 22884 raft_consensus.cc:3037] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:14.265178 22881 raft_consensus.cc:504] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:40:14.265185 22991 raft_consensus.cc:504] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:40:14.271950 22991 leader_election.cc:288] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [CANDIDATE]: Term 3 election: Requested vote from peers ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693), cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489)
I20260807 13:40:14.272500 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a635ded89e9c481bbd9d31bcd04ed678" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
I20260807 13:40:14.273746 22781 raft_consensus.cc:3032] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:40:14.273921 22987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a635ded89e9c481bbd9d31bcd04ed678" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d356524433a542328c096746bed5abef"
I20260807 13:40:14.274036 22882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507d17016e0d4daaa005e6cef4e44bbe" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
I20260807 13:40:14.274468 22987 raft_consensus.cc:3037] T a635ded89e9c481bbd9d31bcd04ed678 P d356524433a542328c096746bed5abef [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:14.274564 22882 raft_consensus.cc:3037] T 507d17016e0d4daaa005e6cef4e44bbe P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:14.275022 22780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507d17016e0d4daaa005e6cef4e44bbe" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
I20260807 13:40:14.275784 22780 raft_consensus.cc:3032] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:14.276072 22780 raft_consensus.cc:729] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Running, Role: LEADER
I20260807 13:40:14.276181 22884 raft_consensus.cc:504] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:40:14.276747 22780 consensus_queue.cc:260] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:40:14.278884 22780 raft_consensus.cc:3037] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:14.281126 22884 leader_election.cc:288] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 4 election: Requested vote from peers ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693), d356524433a542328c096746bed5abef (127.21.82.67:36453)
I20260807 13:40:14.281229 22784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5872d5bc74e4657867e0d2cafb86ad6" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
I20260807 13:40:14.282415 22784 raft_consensus.cc:3032] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:40:14.274147 22781 raft_consensus.cc:729] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Running, Role: LEADER
I20260807 13:40:14.282805 22784 raft_consensus.cc:729] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Running, Role: LEADER
I20260807 13:40:14.283012 22991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5872d5bc74e4657867e0d2cafb86ad6" candidate_uuid: "cc4e4942424c4427931538dabfc6b63d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d356524433a542328c096746bed5abef"
I20260807 13:40:14.284242 22991 raft_consensus.cc:3037] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:14.283592 22781 consensus_queue.cc:260] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:40:14.284206 22784 consensus_queue.cc:260] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:40:14.285249 22781 raft_consensus.cc:3037] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:14.285519 22784 raft_consensus.cc:3037] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:14.287714 22882 raft_consensus.cc:2454] T 507d17016e0d4daaa005e6cef4e44bbe P cc4e4942424c4427931538dabfc6b63d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d356524433a542328c096746bed5abef in term 3.
I20260807 13:40:14.278894 22881 leader_election.cc:288] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 4 election: Requested vote from peers ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693), d356524433a542328c096746bed5abef (127.21.82.67:36453)
I20260807 13:40:14.290300 22942 leader_election.cc:302] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, d356524433a542328c096746bed5abef; no voters:
I20260807 13:40:14.292433 23344 raft_consensus.cc:2781] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:14.295409 22780 raft_consensus.cc:2454] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d356524433a542328c096746bed5abef in term 3.
I20260807 13:40:14.299749 22784 raft_consensus.cc:2454] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc4e4942424c4427931538dabfc6b63d in term 4.
I20260807 13:40:14.301962 22837 leader_election.cc:302] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, ce1db935895842f49ccbd894ab313d5c; no voters:
I20260807 13:40:14.302472 22991 raft_consensus.cc:2454] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc4e4942424c4427931538dabfc6b63d in term 4.
I20260807 13:40:14.303586 23342 raft_consensus.cc:2781] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:40:14.303414 23344 raft_consensus.cc:686] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [term 3 LEADER]: Becoming Leader. State: Replica: d356524433a542328c096746bed5abef, State: Running, Role: LEADER
I20260807 13:40:14.305193 22987 raft_consensus.cc:2454] T a635ded89e9c481bbd9d31bcd04ed678 P d356524433a542328c096746bed5abef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc4e4942424c4427931538dabfc6b63d in term 4.
I20260807 13:40:14.305119 23344 consensus_queue.cc:237] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:40:14.307442 22835 leader_election.cc:302] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, d356524433a542328c096746bed5abef; no voters:
I20260807 13:40:14.308710 23342 raft_consensus.cc:686] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 4 LEADER]: Becoming Leader. State: Replica: cc4e4942424c4427931538dabfc6b63d, State: Running, Role: LEADER
I20260807 13:40:14.310274 23353 raft_consensus.cc:2781] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:40:14.307542 22781 raft_consensus.cc:2454] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc4e4942424c4427931538dabfc6b63d in term 4.
I20260807 13:40:14.311005 23353 raft_consensus.cc:686] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [term 4 LEADER]: Becoming Leader. State: Replica: cc4e4942424c4427931538dabfc6b63d, State: Running, Role: LEADER
I20260807 13:40:14.311120 23342 consensus_queue.cc:237] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:40:14.312233 23353 consensus_queue.cc:237] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:40:14.326124 22635 catalog_manager.cc:5495] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d reported cstate change: term changed from 3 to 4, leader changed from ce1db935895842f49ccbd894ab313d5c (127.21.82.65) to cc4e4942424c4427931538dabfc6b63d (127.21.82.66). New cstate: current_term: 4 leader_uuid: "cc4e4942424c4427931538dabfc6b63d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:14.329537 22637 catalog_manager.cc:5495] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef reported cstate change: term changed from 2 to 3, leader changed from ce1db935895842f49ccbd894ab313d5c (127.21.82.65) to d356524433a542328c096746bed5abef (127.21.82.67). New cstate: current_term: 3 leader_uuid: "d356524433a542328c096746bed5abef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:14.354063 22637 catalog_manager.cc:5495] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d reported cstate change: term changed from 3 to 4, leader changed from ce1db935895842f49ccbd894ab313d5c (127.21.82.65) to cc4e4942424c4427931538dabfc6b63d (127.21.82.66). New cstate: current_term: 4 leader_uuid: "cc4e4942424c4427931538dabfc6b63d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:14.410742 23349 raft_consensus.cc:979] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c: : Instructing follower d356524433a542328c096746bed5abef to start an election
I20260807 13:40:14.411593 23350 raft_consensus.cc:1067] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c [term 2 LEADER]: Signalling peer d356524433a542328c096746bed5abef to start an election
I20260807 13:40:14.414392 22987 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d10115b832134c989a9752a1626893e6"
dest_uuid: "d356524433a542328c096746bed5abef"
from {username='slave'} at 127.0.0.1:39240
I20260807 13:40:14.415295 22987 raft_consensus.cc:482] T d10115b832134c989a9752a1626893e6 P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:40:14.415736 22987 raft_consensus.cc:3037] T d10115b832134c989a9752a1626893e6 P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:14.422219 22987 raft_consensus.cc:504] T d10115b832134c989a9752a1626893e6 P d356524433a542328c096746bed5abef [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:40:14.424027 22987 leader_election.cc:288] T d10115b832134c989a9752a1626893e6 P d356524433a542328c096746bed5abef [CANDIDATE]: Term 3 election: Requested vote from peers ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693), cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489)
I20260807 13:40:14.425027 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d10115b832134c989a9752a1626893e6" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ce1db935895842f49ccbd894ab313d5c"
I20260807 13:40:14.425230 22881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d10115b832134c989a9752a1626893e6" candidate_uuid: "d356524433a542328c096746bed5abef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc4e4942424c4427931538dabfc6b63d"
I20260807 13:40:14.425664 22781 raft_consensus.cc:3032] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:14.425791 22881 raft_consensus.cc:3037] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:14.425982 22781 raft_consensus.cc:729] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce1db935895842f49ccbd894ab313d5c, State: Running, Role: LEADER
I20260807 13:40:14.426743 22781 consensus_queue.cc:260] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:40:14.428004 22781 raft_consensus.cc:3037] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:14.431597 22881 raft_consensus.cc:2454] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d356524433a542328c096746bed5abef in term 3.
I20260807 13:40:14.432893 22942 leader_election.cc:302] T d10115b832134c989a9752a1626893e6 P d356524433a542328c096746bed5abef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc4e4942424c4427931538dabfc6b63d, d356524433a542328c096746bed5abef; no voters:
I20260807 13:40:14.433588 23344 raft_consensus.cc:2781] T d10115b832134c989a9752a1626893e6 P d356524433a542328c096746bed5abef [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:14.433787 22781 raft_consensus.cc:2454] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d356524433a542328c096746bed5abef in term 3.
I20260807 13:40:14.434142 23344 raft_consensus.cc:686] T d10115b832134c989a9752a1626893e6 P d356524433a542328c096746bed5abef [term 3 LEADER]: Becoming Leader. State: Replica: d356524433a542328c096746bed5abef, State: Running, Role: LEADER
I20260807 13:40:14.435292 23344 consensus_queue.cc:237] T d10115b832134c989a9752a1626893e6 P d356524433a542328c096746bed5abef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } }
I20260807 13:40:14.443001 22637 catalog_manager.cc:5495] T d10115b832134c989a9752a1626893e6 P d356524433a542328c096746bed5abef reported cstate change: term changed from 2 to 3, leader changed from ce1db935895842f49ccbd894ab313d5c (127.21.82.65) to d356524433a542328c096746bed5abef (127.21.82.67). New cstate: current_term: 3 leader_uuid: "d356524433a542328c096746bed5abef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:14.725577 22781 raft_consensus.cc:1261] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [term 4 FOLLOWER]: Refusing update from remote peer cc4e4942424c4427931538dabfc6b63d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:40:14.727099 23353 consensus_queue.cc:1035] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:40:14.737485 22987 raft_consensus.cc:1261] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [term 4 FOLLOWER]: Refusing update from remote peer cc4e4942424c4427931538dabfc6b63d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:40:14.739130 23342 consensus_queue.cc:1035] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:40:14.771973 22781 raft_consensus.cc:1261] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 4 FOLLOWER]: Refusing update from remote peer cc4e4942424c4427931538dabfc6b63d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 13:40:14.773377 23342 consensus_queue.cc:1035] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:40:14.782097 22987 raft_consensus.cc:1261] T a635ded89e9c481bbd9d31bcd04ed678 P d356524433a542328c096746bed5abef [term 4 FOLLOWER]: Refusing update from remote peer cc4e4942424c4427931538dabfc6b63d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 13:40:14.783852 23342 consensus_queue.cc:1035] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d356524433a542328c096746bed5abef" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 36453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:40:14.795619 22781 raft_consensus.cc:1261] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [term 3 FOLLOWER]: Refusing update from remote peer d356524433a542328c096746bed5abef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:40:14.796866 23344 consensus_queue.cc:1035] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:40:14.805711 22881 raft_consensus.cc:1261] T 507d17016e0d4daaa005e6cef4e44bbe P cc4e4942424c4427931538dabfc6b63d [term 3 FOLLOWER]: Refusing update from remote peer d356524433a542328c096746bed5abef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:40:14.807152 23385 consensus_queue.cc:1035] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:40:14.956780 22781 raft_consensus.cc:1261] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c [term 3 FOLLOWER]: Refusing update from remote peer d356524433a542328c096746bed5abef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:40:14.959360 23385 consensus_queue.cc:1035] T d10115b832134c989a9752a1626893e6 P d356524433a542328c096746bed5abef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce1db935895842f49ccbd894ab313d5c" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 40693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:40:14.984418 22881 raft_consensus.cc:1261] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [term 3 FOLLOWER]: Refusing update from remote peer d356524433a542328c096746bed5abef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:40:14.988140 23352 consensus_queue.cc:1035] T d10115b832134c989a9752a1626893e6 P d356524433a542328c096746bed5abef [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc4e4942424c4427931538dabfc6b63d" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:40:15.022490 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:40:15.038954 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:40:15.040179 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:40:16.041755 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:40:16.051613 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:40:16.052412 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:40:17.053949 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:40:17.065594 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:40:17.066358 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260807 13:40:17.831583 22736 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.67:36453, user_credentials={real_user=slave}} blocked reactor thread for 50707.3us
I20260807 13:40:18.067728 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:40:18.078143 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:40:18.079044 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:40:19.080158 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:40:19.086623 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:40:19.087159 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:40:20.088081 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:40:20.093809 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:40:20.094283 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:40:21.095688 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:40:21.101325 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:40:21.101850 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:40:22.102990 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:40:22.109231 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:40:22.109642 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:40:23.110477 21833 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:40:23.115679 21833 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:40:23.116106 21833 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:40:24.155023 21833 auto_leader_rebalancer-test.cc:384] The leader distribution is
I20260807 13:40:24.156109 21833 tablet_server.cc:178] TabletServer@127.21.82.65:0 shutting down...
I20260807 13:40:24.195676 21833 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260807 13:40:24.196516 21833 tablet_replica.cc:330] T b81bed43b6aa4d64953c7bd3b5f10d3c P ce1db935895842f49ccbd894ab313d5c: stopping tablet replica
I20260807 13:40:24.197165 21833 raft_consensus.cc:2229] T b81bed43b6aa4d64953c7bd3b5f10d3c P ce1db935895842f49ccbd894ab313d5c [term 2 LEADER]: Raft consensus shutting down.
I20260807 13:40:24.198271 21833 raft_consensus.cc:2258] T b81bed43b6aa4d64953c7bd3b5f10d3c P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:40:24.200737 21833 tablet_replica.cc:330] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c: stopping tablet replica
I20260807 13:40:24.201455 21833 raft_consensus.cc:2229] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 13:40:24.201957 21833 raft_consensus.cc:2258] T a5872d5bc74e4657867e0d2cafb86ad6 P ce1db935895842f49ccbd894ab313d5c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:40:24.204022 21833 tablet_replica.cc:330] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c: stopping tablet replica
I20260807 13:40:24.204655 21833 raft_consensus.cc:2229] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:40:24.205143 21833 raft_consensus.cc:2258] T 507d17016e0d4daaa005e6cef4e44bbe P ce1db935895842f49ccbd894ab313d5c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:40:24.207044 21833 tablet_replica.cc:330] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c: stopping tablet replica
I20260807 13:40:24.207564 21833 raft_consensus.cc:2229] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [term 4 LEADER]: Raft consensus shutting down.
I20260807 13:40:24.208442 21833 raft_consensus.cc:2258] T e234587595554ae183f5b9604ba1c0b9 P ce1db935895842f49ccbd894ab313d5c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:40:24.210203 21833 tablet_replica.cc:330] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c: stopping tablet replica
I20260807 13:40:24.210988 21833 raft_consensus.cc:2229] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:40:24.211477 21833 raft_consensus.cc:2258] T d10115b832134c989a9752a1626893e6 P ce1db935895842f49ccbd894ab313d5c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:40:24.213519 21833 tablet_replica.cc:330] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P ce1db935895842f49ccbd894ab313d5c: stopping tablet replica
I20260807 13:40:24.214095 21833 raft_consensus.cc:2229] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:40:24.214711 21833 raft_consensus.cc:2258] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:40:24.216805 21833 tablet_replica.cc:330] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c: stopping tablet replica
I20260807 13:40:24.217301 21833 raft_consensus.cc:2229] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 13:40:24.217752 21833 raft_consensus.cc:2258] T a635ded89e9c481bbd9d31bcd04ed678 P ce1db935895842f49ccbd894ab313d5c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:40:24.219535 21833 tablet_replica.cc:330] T 124b47385de445e08109ad645d366881 P ce1db935895842f49ccbd894ab313d5c: stopping tablet replica
I20260807 13:40:24.220034 21833 raft_consensus.cc:2229] T 124b47385de445e08109ad645d366881 P ce1db935895842f49ccbd894ab313d5c [term 2 LEADER]: Raft consensus shutting down.
I20260807 13:40:24.220921 21833 raft_consensus.cc:2258] T 124b47385de445e08109ad645d366881 P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:40:24.222754 21833 tablet_replica.cc:330] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c: stopping tablet replica
I20260807 13:40:24.223239 21833 raft_consensus.cc:2229] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:40:24.223687 21833 raft_consensus.cc:2258] T 723969ccd114427893218ff642633ff4 P ce1db935895842f49ccbd894ab313d5c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:40:24.225394 21833 tablet_replica.cc:330] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c: stopping tablet replica
I20260807 13:40:24.225844 21833 raft_consensus.cc:2229] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [term 3 LEADER]: Raft consensus shutting down.
I20260807 13:40:24.226629 21833 raft_consensus.cc:2258] T c9bbe03a111e4a43a9bc12b726d2748e P ce1db935895842f49ccbd894ab313d5c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:40:24.261199 21833 tablet_server.cc:194] TabletServer@127.21.82.65:0 shutdown complete.
I20260807 13:40:24.282437 21833 tablet_server.cc:178] TabletServer@127.21.82.66:0 shutting down...
W20260807 13:40:24.315630 22837 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.82.65:40693: connect: Connection refused (error 111) [suppressed 2 similar messages]
I20260807 13:40:24.317054 21833 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260807 13:40:24.318040 21833 tablet_replica.cc:330] T 507d17016e0d4daaa005e6cef4e44bbe P cc4e4942424c4427931538dabfc6b63d: stopping tablet replica
I20260807 13:40:24.318982 21833 raft_consensus.cc:2229] T 507d17016e0d4daaa005e6cef4e44bbe P cc4e4942424c4427931538dabfc6b63d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:40:24.319782 21833 raft_consensus.cc:2258] T 507d17016e0d4daaa005e6cef4e44bbe P cc4e4942424c4427931538dabfc6b63d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260807 13:40:24.319864 22837 consensus_peers.cc:487] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d -> Peer ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693): Couldn't send request to peer ce1db935895842f49ccbd894ab313d5c. Status: Network error: Client connection negotiation failed: client connection to 127.21.82.65:40693: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:40:24.322748 21833 tablet_replica.cc:330] T b81bed43b6aa4d64953c7bd3b5f10d3c P cc4e4942424c4427931538dabfc6b63d: stopping tablet replica
I20260807 13:40:24.323690 21833 raft_consensus.cc:2229] T b81bed43b6aa4d64953c7bd3b5f10d3c P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:40:24.324240 21833 raft_consensus.cc:2258] T b81bed43b6aa4d64953c7bd3b5f10d3c P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260807 13:40:24.324980 22837 consensus_peers.cc:487] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d -> Peer ce1db935895842f49ccbd894ab313d5c (127.21.82.65:40693): Couldn't send request to peer ce1db935895842f49ccbd894ab313d5c. Status: Network error: Client connection negotiation failed: client connection to 127.21.82.65:40693: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:40:24.326452 21833 tablet_replica.cc:330] T c9bbe03a111e4a43a9bc12b726d2748e P cc4e4942424c4427931538dabfc6b63d: stopping tablet replica
I20260807 13:40:24.327093 21833 raft_consensus.cc:2229] T c9bbe03a111e4a43a9bc12b726d2748e P cc4e4942424c4427931538dabfc6b63d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:40:24.327598 21833 raft_consensus.cc:2258] T c9bbe03a111e4a43a9bc12b726d2748e P cc4e4942424c4427931538dabfc6b63d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:40:24.329656 21833 tablet_replica.cc:330] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d: stopping tablet replica
I20260807 13:40:24.330152 21833 raft_consensus.cc:2229] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d [term 2 LEADER]: Raft consensus shutting down.
I20260807 13:40:24.331015 21833 raft_consensus.cc:2258] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:40:24.332787 21833 tablet_replica.cc:330] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d: stopping tablet replica
I20260807 13:40:24.333307 21833 raft_consensus.cc:2229] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [term 4 LEADER]: Raft consensus shutting down.
I20260807 13:40:24.334129 21833 raft_consensus.cc:2258] T a635ded89e9c481bbd9d31bcd04ed678 P cc4e4942424c4427931538dabfc6b63d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:40:24.335913 21833 tablet_replica.cc:330] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d: stopping tablet replica
I20260807 13:40:24.336441 21833 raft_consensus.cc:2229] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:40:24.336930 21833 raft_consensus.cc:2258] T d10115b832134c989a9752a1626893e6 P cc4e4942424c4427931538dabfc6b63d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:40:24.338490 21833 tablet_replica.cc:330] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d: stopping tablet replica
I20260807 13:40:24.339133 21833 raft_consensus.cc:2229] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 13:40:24.339582 21833 raft_consensus.cc:2258] T e234587595554ae183f5b9604ba1c0b9 P cc4e4942424c4427931538dabfc6b63d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:40:24.341281 21833 tablet_replica.cc:330] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d: stopping tablet replica
I20260807 13:40:24.341776 21833 raft_consensus.cc:2229] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 4 LEADER]: Raft consensus shutting down.
I20260807 13:40:24.342800 21833 raft_consensus.cc:2258] T a5872d5bc74e4657867e0d2cafb86ad6 P cc4e4942424c4427931538dabfc6b63d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:40:24.344559 21833 tablet_replica.cc:330] T 723969ccd114427893218ff642633ff4 P cc4e4942424c4427931538dabfc6b63d: stopping tablet replica
I20260807 13:40:24.345034 21833 raft_consensus.cc:2229] T 723969ccd114427893218ff642633ff4 P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:40:24.345460 21833 raft_consensus.cc:2258] T 723969ccd114427893218ff642633ff4 P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:40:24.347055 21833 tablet_replica.cc:330] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d: stopping tablet replica
I20260807 13:40:24.347512 21833 raft_consensus.cc:2229] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:40:24.347939 21833 raft_consensus.cc:2258] T 124b47385de445e08109ad645d366881 P cc4e4942424c4427931538dabfc6b63d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260807 13:40:24.363961 22942 consensus_peers.cc:487] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef -> Peer cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489): Couldn't send request to peer cc4e4942424c4427931538dabfc6b63d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260807 13:40:24.372056 22942 consensus_peers.cc:487] T 723969ccd114427893218ff642633ff4 P d356524433a542328c096746bed5abef -> Peer cc4e4942424c4427931538dabfc6b63d (127.21.82.66:46489): Couldn't send request to peer cc4e4942424c4427931538dabfc6b63d. Status: Network error: Client connection negotiation failed: client connection to 127.21.82.66:46489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:40:24.379562 21833 tablet_server.cc:194] TabletServer@127.21.82.66:0 shutdown complete.
I20260807 13:40:24.399948 21833 tablet_server.cc:178] TabletServer@127.21.82.67:0 shutting down...
I20260807 13:40:24.438599 21833 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260807 13:40:24.439415 21833 tablet_replica.cc:330] T a635ded89e9c481bbd9d31bcd04ed678 P d356524433a542328c096746bed5abef: stopping tablet replica
I20260807 13:40:24.440114 21833 raft_consensus.cc:2229] T a635ded89e9c481bbd9d31bcd04ed678 P d356524433a542328c096746bed5abef [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 13:40:24.440642 21833 raft_consensus.cc:2258] T a635ded89e9c481bbd9d31bcd04ed678 P d356524433a542328c096746bed5abef [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:40:24.442544 21833 tablet_replica.cc:330] T d10115b832134c989a9752a1626893e6 P d356524433a542328c096746bed5abef: stopping tablet replica
I20260807 13:40:24.443135 21833 raft_consensus.cc:2229] T d10115b832134c989a9752a1626893e6 P d356524433a542328c096746bed5abef [term 3 LEADER]: Raft consensus shutting down.
I20260807 13:40:24.444024 21833 raft_consensus.cc:2258] T d10115b832134c989a9752a1626893e6 P d356524433a542328c096746bed5abef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:40:24.445724 21833 tablet_replica.cc:330] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef: stopping tablet replica
I20260807 13:40:24.446266 21833 raft_consensus.cc:2229] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:40:24.446708 21833 raft_consensus.cc:2258] T 69f0e9ea6b784ea89a5cb1fcc5a0293e P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:40:24.448302 21833 tablet_replica.cc:330] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef: stopping tablet replica
I20260807 13:40:24.448809 21833 raft_consensus.cc:2229] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:40:24.449226 21833 raft_consensus.cc:2258] T c9bbe03a111e4a43a9bc12b726d2748e P d356524433a542328c096746bed5abef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:40:24.451095 21833 tablet_replica.cc:330] T 723969ccd114427893218ff642633ff4 P d356524433a542328c096746bed5abef: stopping tablet replica
I20260807 13:40:24.451591 21833 raft_consensus.cc:2229] T 723969ccd114427893218ff642633ff4 P d356524433a542328c096746bed5abef [term 2 LEADER]: Raft consensus shutting down.
I20260807 13:40:24.452409 21833 raft_consensus.cc:2258] T 723969ccd114427893218ff642633ff4 P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:40:24.454087 21833 tablet_replica.cc:330] T 124b47385de445e08109ad645d366881 P d356524433a542328c096746bed5abef: stopping tablet replica
I20260807 13:40:24.454577 21833 raft_consensus.cc:2229] T 124b47385de445e08109ad645d366881 P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:40:24.455044 21833 raft_consensus.cc:2258] T 124b47385de445e08109ad645d366881 P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:40:24.456913 21833 tablet_replica.cc:330] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef: stopping tablet replica
I20260807 13:40:24.457405 21833 raft_consensus.cc:2229] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 13:40:24.457837 21833 raft_consensus.cc:2258] T a5872d5bc74e4657867e0d2cafb86ad6 P d356524433a542328c096746bed5abef [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:40:24.459503 21833 tablet_replica.cc:330] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef: stopping tablet replica
I20260807 13:40:24.460000 21833 raft_consensus.cc:2229] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:40:24.460443 21833 raft_consensus.cc:2258] T b81bed43b6aa4d64953c7bd3b5f10d3c P d356524433a542328c096746bed5abef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:40:24.462347 21833 tablet_replica.cc:330] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef: stopping tablet replica
I20260807 13:40:24.462882 21833 raft_consensus.cc:2229] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 13:40:24.463374 21833 raft_consensus.cc:2258] T e234587595554ae183f5b9604ba1c0b9 P d356524433a542328c096746bed5abef [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:40:24.465361 21833 tablet_replica.cc:330] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef: stopping tablet replica
I20260807 13:40:24.465819 21833 raft_consensus.cc:2229] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [term 3 LEADER]: Raft consensus shutting down.
I20260807 13:40:24.466606 21833 raft_consensus.cc:2258] T 507d17016e0d4daaa005e6cef4e44bbe P d356524433a542328c096746bed5abef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:40:24.496428 21833 tablet_server.cc:194] TabletServer@127.21.82.67:0 shutdown complete.
I20260807 13:40:24.517931 21833 master.cc:537] Master@127.21.82.126:38765 shutting down...
I20260807 13:40:24.542318 21833 raft_consensus.cc:2229] T 00000000000000000000000000000000 P f92780d5985648c392d9a47e02c93b51 [term 1 LEADER]: Raft consensus shutting down.
I20260807 13:40:24.543031 21833 raft_consensus.cc:2258] T 00000000000000000000000000000000 P f92780d5985648c392d9a47e02c93b51 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:40:24.543347 21833 tablet_replica.cc:330] T 00000000000000000000000000000000 P f92780d5985648c392d9a47e02c93b51: stopping tablet replica
I20260807 13:40:24.563688 21833 master.cc:552] Master@127.21.82.126:38765 shutdown complete.
cc4e4942424c4427931538dabfc6b63d 4
ce1db935895842f49ccbd894ab313d5c 5
d356524433a542328c096746bed5abef 1
cc4e4942424c4427931538dabfc6b63d 4
ce1db935895842f49ccbd894ab313d5c 3
d356524433a542328c096746bed5abef 3
cc4e4942424c4427931538dabfc6b63d 1
ce1db935895842f49ccbd894ab313d5c 8
d356524433a542328c096746bed5abef 1
cc4e4942424c4427931538dabfc6b63d 3
ce1db935895842f49ccbd894ab313d5c 4
d356524433a542328c096746bed5abef 3
[ OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (30384 ms)
[ RUN ] LeaderRebalancerTest.AddTserver
I20260807 13:40:24.611042 21833 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.21.82.126:40997
I20260807 13:40:24.612246 21833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:40:24.620055 23416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:40:24.620070 23418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:40:24.620957 23420 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:40:24.621451 21833 server_base.cc:1034] running on GCE node
I20260807 13:40:24.622586 21833 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:40:24.623250 21833 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:40:24.623387 21833 hybrid_clock.cc:648] HybridClock initialized: now 1786110024623376 us; error 0 us; skew 500 ppm
I20260807 13:40:24.623980 21833 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:40:24.632161 21833 webserver.cc:460] Webserver started at http://127.21.82.126:40073/ using document root <none> and password file <none>
I20260807 13:40:24.632753 21833 fs_manager.cc:359] Metadata directory not provided
I20260807 13:40:24.632930 21833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:40:24.633304 21833 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:40:24.635540 21833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109960278411-21833-0/minicluster-data/master-0-root/instance:
uuid: "8d9f7da4966a48d19a772a0a16fcf6da"
format_stamp: "Formatted at 2026-08-07 13:40:24 on dist-test-slave-3kk6"
I20260807 13:40:24.640794 21833 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 13:40:24.644410 23427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:40:24.645244 21833 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 13:40:24.645658 21833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109960278411-21833-0/minicluster-data/master-0-root
uuid: "8d9f7da4966a48d19a772a0a16fcf6da"
format_stamp: "Formatted at 2026-08-07 13:40:24 on dist-test-slave-3kk6"
I20260807 13:40:24.645965 21833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109960278411-21833-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109960278411-21833-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109960278411-21833-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:40:24.656666 21833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:40:24.658083 21833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:40:24.700824 21833 rpc_server.cc:307] RPC server started. Bound to: 127.21.82.126:40997
I20260807 13:40:24.700898 23513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.82.126:40997 every 8 connection(s)
I20260807 13:40:24.705057 23515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:24.716398 23515 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da: Bootstrap starting.
I20260807 13:40:24.721123 23515 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:24.725841 23515 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da: No bootstrap required, opened a new log
I20260807 13:40:24.728307 23515 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d9f7da4966a48d19a772a0a16fcf6da" member_type: VOTER }
I20260807 13:40:24.728904 23515 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:24.729185 23515 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d9f7da4966a48d19a772a0a16fcf6da, State: Initialized, Role: FOLLOWER
I20260807 13:40:24.729928 23515 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d9f7da4966a48d19a772a0a16fcf6da" member_type: VOTER }
I20260807 13:40:24.730422 23515 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 13:40:24.730697 23515 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 13:40:24.730988 23515 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:24.735450 23515 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d9f7da4966a48d19a772a0a16fcf6da" member_type: VOTER }
I20260807 13:40:24.736037 23515 leader_election.cc:302] T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8d9f7da4966a48d19a772a0a16fcf6da; no voters:
I20260807 13:40:24.737301 23515 leader_election.cc:288] T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 13:40:24.737668 23519 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:24.739151 23519 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da [term 1 LEADER]: Becoming Leader. State: Replica: 8d9f7da4966a48d19a772a0a16fcf6da, State: Running, Role: LEADER
I20260807 13:40:24.739928 23519 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d9f7da4966a48d19a772a0a16fcf6da" member_type: VOTER }
I20260807 13:40:24.740571 23515 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da [sys.catalog]: configured and running, proceeding with master startup.
I20260807 13:40:24.745550 23522 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d9f7da4966a48d19a772a0a16fcf6da. Latest consensus state: current_term: 1 leader_uuid: "8d9f7da4966a48d19a772a0a16fcf6da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d9f7da4966a48d19a772a0a16fcf6da" member_type: VOTER } }
I20260807 13:40:24.747989 23522 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da [sys.catalog]: This master's current role is: LEADER
I20260807 13:40:24.746848 23521 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8d9f7da4966a48d19a772a0a16fcf6da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d9f7da4966a48d19a772a0a16fcf6da" member_type: VOTER } }
I20260807 13:40:24.749423 23521 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da [sys.catalog]: This master's current role is: LEADER
I20260807 13:40:24.752568 23530 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 13:40:24.758175 23530 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 13:40:24.761933 21833 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260807 13:40:24.768618 23530 catalog_manager.cc:1347] Generated new cluster ID: 40a6795a3964413185e9fbdbdf4d6c31
I20260807 13:40:24.768940 23530 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 13:40:24.783497 23530 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 13:40:24.785202 23530 catalog_manager.cc:1504] Loading token signing keys...
I20260807 13:40:24.804246 23530 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da: Generated new TSK 0
I20260807 13:40:24.804973 23530 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 13:40:24.828604 21833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:40:24.835129 23545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:40:24.836619 23546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:40:24.838508 21833 server_base.cc:1034] running on GCE node
W20260807 13:40:24.838467 23548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:40:24.839833 21833 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:40:24.840072 21833 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:40:24.840260 21833 hybrid_clock.cc:648] HybridClock initialized: now 1786110024840237 us; error 0 us; skew 500 ppm
I20260807 13:40:24.840785 21833 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:40:24.843570 21833 webserver.cc:460] Webserver started at http://127.21.82.65:42897/ using document root <none> and password file <none>
I20260807 13:40:24.844065 21833 fs_manager.cc:359] Metadata directory not provided
I20260807 13:40:24.844280 21833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:40:24.844561 21833 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:40:24.845744 21833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109960278411-21833-0/minicluster-data/ts-0-root/instance:
uuid: "08757cfbeffb41bbab14c2ef00e9d812"
format_stamp: "Formatted at 2026-08-07 13:40:24 on dist-test-slave-3kk6"
I20260807 13:40:24.850991 21833 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260807 13:40:24.854532 23553 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:40:24.855499 21833 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 13:40:24.855863 21833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109960278411-21833-0/minicluster-data/ts-0-root
uuid: "08757cfbeffb41bbab14c2ef00e9d812"
format_stamp: "Formatted at 2026-08-07 13:40:24 on dist-test-slave-3kk6"
I20260807 13:40:24.856170 21833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109960278411-21833-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109960278411-21833-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109960278411-21833-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:40:24.895306 21833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:40:24.896615 21833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:40:24.898270 21833 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 13:40:24.900849 21833 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:40:24.901033 21833 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:40:24.901335 21833 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 13:40:24.901513 21833 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:40:24.946986 21833 rpc_server.cc:307] RPC server started. Bound to: 127.21.82.65:33187
I20260807 13:40:24.947193 23637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.82.65:33187 every 8 connection(s)
I20260807 13:40:24.952360 21833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:40:24.961236 23644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:40:24.963143 23646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:40:24.963888 23649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:40:24.966089 21833 server_base.cc:1034] running on GCE node
I20260807 13:40:24.967730 21833 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:40:24.968003 21833 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:40:24.968217 21833 hybrid_clock.cc:648] HybridClock initialized: now 1786110024968200 us; error 0 us; skew 500 ppm
I20260807 13:40:24.968828 21833 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:40:24.971583 23638 heartbeater.cc:347] Connected to a master server at 127.21.82.126:40997
I20260807 13:40:24.972153 23638 heartbeater.cc:464] Registering TS with master...
I20260807 13:40:24.972110 21833 webserver.cc:460] Webserver started at http://127.21.82.66:44973/ using document root <none> and password file <none>
I20260807 13:40:24.972849 21833 fs_manager.cc:359] Metadata directory not provided
I20260807 13:40:24.973112 21833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:40:24.973133 23638 heartbeater.cc:511] Master 127.21.82.126:40997 requested a full tablet report, sending...
I20260807 13:40:24.973564 21833 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:40:24.975170 21833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109960278411-21833-0/minicluster-data/ts-1-root/instance:
uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
format_stamp: "Formatted at 2026-08-07 13:40:24 on dist-test-slave-3kk6"
I20260807 13:40:24.975922 23450 ts_manager.cc:194] Registered new tserver with Master: 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187)
I20260807 13:40:24.978816 23450 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37954
I20260807 13:40:24.981680 21833 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260807 13:40:24.985616 23659 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:40:24.986444 21833 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 13:40:24.986815 21833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109960278411-21833-0/minicluster-data/ts-1-root
uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
format_stamp: "Formatted at 2026-08-07 13:40:24 on dist-test-slave-3kk6"
I20260807 13:40:24.987104 21833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109960278411-21833-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109960278411-21833-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109960278411-21833-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:40:24.998522 21833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:40:25.000227 21833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:40:25.001791 21833 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 13:40:25.004235 21833 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:40:25.004478 21833 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:40:25.004716 21833 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 13:40:25.004880 21833 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:40:25.047459 21833 rpc_server.cc:307] RPC server started. Bound to: 127.21.82.66:38833
I20260807 13:40:25.047670 23751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.82.66:38833 every 8 connection(s)
I20260807 13:40:25.052655 21833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:40:25.061321 23758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:40:25.063388 23757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:40:25.063557 23760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:40:25.064852 21833 server_base.cc:1034] running on GCE node
I20260807 13:40:25.065841 21833 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:40:25.066113 21833 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:40:25.066315 21833 hybrid_clock.cc:648] HybridClock initialized: now 1786110025066298 us; error 0 us; skew 500 ppm
I20260807 13:40:25.067075 21833 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:40:25.067993 23752 heartbeater.cc:347] Connected to a master server at 127.21.82.126:40997
I20260807 13:40:25.068461 23752 heartbeater.cc:464] Registering TS with master...
I20260807 13:40:25.069218 23752 heartbeater.cc:511] Master 127.21.82.126:40997 requested a full tablet report, sending...
I20260807 13:40:25.069790 21833 webserver.cc:460] Webserver started at http://127.21.82.67:46507/ using document root <none> and password file <none>
I20260807 13:40:25.070322 21833 fs_manager.cc:359] Metadata directory not provided
I20260807 13:40:25.070536 21833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:40:25.070822 21833 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:40:25.071316 23450 ts_manager.cc:194] Registered new tserver with Master: 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:25.072089 21833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109960278411-21833-0/minicluster-data/ts-2-root/instance:
uuid: "d28e736aee9f4f01b013de670a762697"
format_stamp: "Formatted at 2026-08-07 13:40:25 on dist-test-slave-3kk6"
I20260807 13:40:25.072996 23450 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37962
I20260807 13:40:25.076683 21833 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 13:40:25.079998 23767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:40:25.080749 21833 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 13:40:25.081056 21833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109960278411-21833-0/minicluster-data/ts-2-root
uuid: "d28e736aee9f4f01b013de670a762697"
format_stamp: "Formatted at 2026-08-07 13:40:25 on dist-test-slave-3kk6"
I20260807 13:40:25.081357 21833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109960278411-21833-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109960278411-21833-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109960278411-21833-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:40:25.092641 21833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:40:25.093925 21833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:40:25.095569 21833 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 13:40:25.097828 21833 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:40:25.098061 21833 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:40:25.098315 21833 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 13:40:25.098486 21833 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:40:25.140810 21833 rpc_server.cc:307] RPC server started. Bound to: 127.21.82.67:46685
I20260807 13:40:25.140991 23861 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.82.67:46685 every 8 connection(s)
I20260807 13:40:25.157507 23863 heartbeater.cc:347] Connected to a master server at 127.21.82.126:40997
I20260807 13:40:25.158006 23863 heartbeater.cc:464] Registering TS with master...
I20260807 13:40:25.158841 23863 heartbeater.cc:511] Master 127.21.82.126:40997 requested a full tablet report, sending...
I20260807 13:40:25.160805 23450 ts_manager.cc:194] Registered new tserver with Master: d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:25.161585 21833 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016647581s
I20260807 13:40:25.162401 23450 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37968
I20260807 13:40:25.164197 21833 test_util.cc:268] Using random seed: 630482317
I20260807 13:40:25.190110 23450 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37978:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 13:40:25.196501 23450 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 13:40:25.432258 23698 tablet_service.cc:1467] Processing CreateTablet for tablet a53e76fbfae64579bb651f346fd4157c (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260807 13:40:25.436301 23811 tablet_service.cc:1467] Processing CreateTablet for tablet a53e76fbfae64579bb651f346fd4157c (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260807 13:40:25.437315 23808 tablet_service.cc:1467] Processing CreateTablet for tablet 2f0a69bc60e24041b730133061e67069 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260807 13:40:25.437836 23811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a53e76fbfae64579bb651f346fd4157c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.438884 23808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f0a69bc60e24041b730133061e67069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.441761 23809 tablet_service.cc:1467] Processing CreateTablet for tablet 620e30fb1ff34164a7a4f66804acc719 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260807 13:40:25.444332 23807 tablet_service.cc:1467] Processing CreateTablet for tablet 214fb4bbf05e4280a55113485d8ce2f5 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260807 13:40:25.446292 23807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 214fb4bbf05e4280a55113485d8ce2f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.448316 23806 tablet_service.cc:1467] Processing CreateTablet for tablet e6df7e3fe3a74e6d818aeb532b42d6ba (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260807 13:40:25.453493 23694 tablet_service.cc:1467] Processing CreateTablet for tablet 214fb4bbf05e4280a55113485d8ce2f5 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260807 13:40:25.460604 23695 tablet_service.cc:1467] Processing CreateTablet for tablet 2f0a69bc60e24041b730133061e67069 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260807 13:40:25.456687 23805 tablet_service.cc:1467] Processing CreateTablet for tablet 2d905bf8af8b40f2b6cb105bf7d73ea5 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260807 13:40:25.463615 23691 tablet_service.cc:1467] Processing CreateTablet for tablet 2d905bf8af8b40f2b6cb105bf7d73ea5 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260807 13:40:25.464788 23692 tablet_service.cc:1467] Processing CreateTablet for tablet e6df7e3fe3a74e6d818aeb532b42d6ba (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260807 13:40:25.465133 23689 tablet_service.cc:1467] Processing CreateTablet for tablet bd314efc5fa240fe8e411f52346a18f1 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260807 13:40:25.439064 23696 tablet_service.cc:1467] Processing CreateTablet for tablet 620e30fb1ff34164a7a4f66804acc719 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260807 13:40:25.455504 23698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a53e76fbfae64579bb651f346fd4157c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.473703 23686 tablet_service.cc:1467] Processing CreateTablet for tablet 1099c0db8e4147fd86d0e1ba1162ab82 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260807 13:40:25.474238 23685 tablet_service.cc:1467] Processing CreateTablet for tablet f8c48f8bcc0a41aa9267cc72e645a3ca (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260807 13:40:25.475435 23688 tablet_service.cc:1467] Processing CreateTablet for tablet f2f67b0d087a474ea05fb3c7ceb2f5ae (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260807 13:40:25.476258 23805 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d905bf8af8b40f2b6cb105bf7d73ea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.477018 23809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 620e30fb1ff34164a7a4f66804acc719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.478006 23808 tablet_service.cc:1467] Processing CreateTablet for tablet bd314efc5fa240fe8e411f52346a18f1 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260807 13:40:25.479357 23808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd314efc5fa240fe8e411f52346a18f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.483134 23806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6df7e3fe3a74e6d818aeb532b42d6ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.484445 23804 tablet_service.cc:1467] Processing CreateTablet for tablet f2f67b0d087a474ea05fb3c7ceb2f5ae (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260807 13:40:25.485517 23688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2f67b0d087a474ea05fb3c7ceb2f5ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.485881 23804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2f67b0d087a474ea05fb3c7ceb2f5ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.490949 23686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1099c0db8e4147fd86d0e1ba1162ab82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.491878 23689 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd314efc5fa240fe8e411f52346a18f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.495072 23694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 214fb4bbf05e4280a55113485d8ce2f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.499084 23692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6df7e3fe3a74e6d818aeb532b42d6ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.500443 23803 tablet_service.cc:1467] Processing CreateTablet for tablet 1099c0db8e4147fd86d0e1ba1162ab82 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260807 13:40:25.501845 23803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1099c0db8e4147fd86d0e1ba1162ab82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.503037 23685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8c48f8bcc0a41aa9267cc72e645a3ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.504598 23802 tablet_service.cc:1467] Processing CreateTablet for tablet f8c48f8bcc0a41aa9267cc72e645a3ca (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260807 13:40:25.505824 23696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 620e30fb1ff34164a7a4f66804acc719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.506032 23802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8c48f8bcc0a41aa9267cc72e645a3ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.508538 23801 tablet_service.cc:1467] Processing CreateTablet for tablet b8004e179e4945ada49709b2ebf227e7 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260807 13:40:25.509990 23801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8004e179e4945ada49709b2ebf227e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.511046 23691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d905bf8af8b40f2b6cb105bf7d73ea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.515049 23695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f0a69bc60e24041b730133061e67069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.558151 23811 tablet_service.cc:1467] Processing CreateTablet for tablet 966ce2c21a0a4a6cb65aaf5e0bfe8eac (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260807 13:40:25.559712 23811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 966ce2c21a0a4a6cb65aaf5e0bfe8eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.559998 23583 tablet_service.cc:1467] Processing CreateTablet for tablet e6df7e3fe3a74e6d818aeb532b42d6ba (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260807 13:40:25.561071 23587 tablet_service.cc:1467] Processing CreateTablet for tablet a53e76fbfae64579bb651f346fd4157c (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260807 13:40:25.561493 23583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6df7e3fe3a74e6d818aeb532b42d6ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.562453 23587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a53e76fbfae64579bb651f346fd4157c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.563899 23586 tablet_service.cc:1467] Processing CreateTablet for tablet 620e30fb1ff34164a7a4f66804acc719 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260807 13:40:25.570022 23584 tablet_service.cc:1467] Processing CreateTablet for tablet 214fb4bbf05e4280a55113485d8ce2f5 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260807 13:40:25.570022 23582 tablet_service.cc:1467] Processing CreateTablet for tablet 2d905bf8af8b40f2b6cb105bf7d73ea5 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260807 13:40:25.571193 23581 tablet_service.cc:1467] Processing CreateTablet for tablet bd314efc5fa240fe8e411f52346a18f1 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260807 13:40:25.573091 23580 tablet_service.cc:1467] Processing CreateTablet for tablet f2f67b0d087a474ea05fb3c7ceb2f5ae (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260807 13:40:25.578572 23585 tablet_service.cc:1467] Processing CreateTablet for tablet 2f0a69bc60e24041b730133061e67069 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260807 13:40:25.582868 23884 tablet_bootstrap.cc:492] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:25.588778 23586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 620e30fb1ff34164a7a4f66804acc719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.579608 23881 tablet_bootstrap.cc:492] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:25.596230 23579 tablet_service.cc:1467] Processing CreateTablet for tablet 1099c0db8e4147fd86d0e1ba1162ab82 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260807 13:40:25.598207 23685 tablet_service.cc:1467] Processing CreateTablet for tablet b8004e179e4945ada49709b2ebf227e7 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260807 13:40:25.598292 23578 tablet_service.cc:1467] Processing CreateTablet for tablet f8c48f8bcc0a41aa9267cc72e645a3ca (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260807 13:40:25.610057 23884 tablet_bootstrap.cc:654] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:25.612022 23881 tablet_bootstrap.cc:654] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:25.618295 23585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f0a69bc60e24041b730133061e67069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.623312 23584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 214fb4bbf05e4280a55113485d8ce2f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.627287 23582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d905bf8af8b40f2b6cb105bf7d73ea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.633013 23579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1099c0db8e4147fd86d0e1ba1162ab82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.633783 23578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8c48f8bcc0a41aa9267cc72e645a3ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.639392 23581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd314efc5fa240fe8e411f52346a18f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.647109 23580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2f67b0d087a474ea05fb3c7ceb2f5ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.648782 23804 tablet_service.cc:1467] Processing CreateTablet for tablet b213bed392294fcfb09b79938e6b85b6 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260807 13:40:25.650573 23804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b213bed392294fcfb09b79938e6b85b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.651634 23698 tablet_service.cc:1467] Processing CreateTablet for tablet 966ce2c21a0a4a6cb65aaf5e0bfe8eac (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260807 13:40:25.655233 23685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8004e179e4945ada49709b2ebf227e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.659148 23698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 966ce2c21a0a4a6cb65aaf5e0bfe8eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.663743 23805 tablet_service.cc:1467] Processing CreateTablet for tablet 689213e52b434d3bb11b840c79916a65 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260807 13:40:25.665081 23805 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 689213e52b434d3bb11b840c79916a65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.673085 23695 tablet_service.cc:1467] Processing CreateTablet for tablet 689213e52b434d3bb11b840c79916a65 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260807 13:40:25.680003 23692 tablet_service.cc:1467] Processing CreateTablet for tablet b213bed392294fcfb09b79938e6b85b6 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260807 13:40:25.698783 23801 tablet_service.cc:1467] Processing CreateTablet for tablet 7800087414314b9983dee88fd1b6ccb5 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260807 13:40:25.700176 23801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7800087414314b9983dee88fd1b6ccb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.700476 23806 tablet_service.cc:1467] Processing CreateTablet for tablet aa5fcc43292246d486ebba83eac423d6 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260807 13:40:25.701686 23806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa5fcc43292246d486ebba83eac423d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.670027 23808 tablet_service.cc:1467] Processing CreateTablet for tablet 09c37fe84a4c44ef8aa1fa514c7179b6 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260807 13:40:25.714035 23689 tablet_service.cc:1467] Processing CreateTablet for tablet ed0a63d9cc9e4b7bad0c1d1a83f10228 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260807 13:40:25.716012 23686 tablet_service.cc:1467] Processing CreateTablet for tablet 09c37fe84a4c44ef8aa1fa514c7179b6 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260807 13:40:25.728183 23688 tablet_service.cc:1467] Processing CreateTablet for tablet e1e9a929f1fe4faeb8fc3a072191c41a (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260807 13:40:25.739574 23805 tablet_service.cc:1467] Processing CreateTablet for tablet cf2e5e45fca749498a80852c430edb21 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260807 13:40:25.717097 23811 tablet_service.cc:1467] Processing CreateTablet for tablet 7e285d5ba5024cee8ad635138ef44fd5 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260807 13:40:25.718261 23808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09c37fe84a4c44ef8aa1fa514c7179b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.719019 23809 tablet_service.cc:1467] Processing CreateTablet for tablet ed0a63d9cc9e4b7bad0c1d1a83f10228 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260807 13:40:25.724390 23685 tablet_service.cc:1467] Processing CreateTablet for tablet aa5fcc43292246d486ebba83eac423d6 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260807 13:40:25.724766 23802 tablet_service.cc:1467] Processing CreateTablet for tablet a8d8d3a6cd704602b71ac7d5122cf9cf (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260807 13:40:25.726069 23694 tablet_service.cc:1467] Processing CreateTablet for tablet a8d8d3a6cd704602b71ac7d5122cf9cf (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260807 13:40:25.726796 23696 tablet_service.cc:1467] Processing CreateTablet for tablet 7e285d5ba5024cee8ad635138ef44fd5 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260807 13:40:25.728219 23884 tablet_bootstrap.cc:492] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:25.730926 23581 tablet_service.cc:1467] Processing CreateTablet for tablet b8004e179e4945ada49709b2ebf227e7 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260807 13:40:25.734457 23807 tablet_service.cc:1467] Processing CreateTablet for tablet e1e9a929f1fe4faeb8fc3a072191c41a (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260807 13:40:25.709714 23695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 689213e52b434d3bb11b840c79916a65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.716264 23691 tablet_service.cc:1467] Processing CreateTablet for tablet 7800087414314b9983dee88fd1b6ccb5 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260807 13:40:25.743021 23888 tablet_bootstrap.cc:492] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:25.781388 23578 tablet_service.cc:1467] Processing CreateTablet for tablet 7e285d5ba5024cee8ad635138ef44fd5 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260807 13:40:25.745779 23811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e285d5ba5024cee8ad635138ef44fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.783480 23809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed0a63d9cc9e4b7bad0c1d1a83f10228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.784194 23802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8d8d3a6cd704602b71ac7d5122cf9cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.783936 23804 tablet_service.cc:1467] Processing CreateTablet for tablet b8a6dd54ac4d4a8b9227a3d3ee9fafb6 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260807 13:40:25.785204 23804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8a6dd54ac4d4a8b9227a3d3ee9fafb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.787103 23805 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf2e5e45fca749498a80852c430edb21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.747679 23585 tablet_service.cc:1467] Processing CreateTablet for tablet b213bed392294fcfb09b79938e6b85b6 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260807 13:40:25.786999 23584 tablet_service.cc:1467] Processing CreateTablet for tablet 689213e52b434d3bb11b840c79916a65 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260807 13:40:25.751955 23579 tablet_service.cc:1467] Processing CreateTablet for tablet 09c37fe84a4c44ef8aa1fa514c7179b6 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260807 13:40:25.753228 23884 ts_tablet_manager.cc:1397] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.171s user 0.024s sys 0.024s
I20260807 13:40:25.789162 23807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1e9a929f1fe4faeb8fc3a072191c41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.753655 23581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8004e179e4945ada49709b2ebf227e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.789858 23580 tablet_service.cc:1467] Processing CreateTablet for tablet ed0a63d9cc9e4b7bad0c1d1a83f10228 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260807 13:40:25.754482 23685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa5fcc43292246d486ebba83eac423d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.792254 23692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b213bed392294fcfb09b79938e6b85b6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 13:40:25.757164 23535 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:40:25.792807 23689 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed0a63d9cc9e4b7bad0c1d1a83f10228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.760603 23881 tablet_bootstrap.cc:492] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:25.767323 23587 tablet_service.cc:1467] Processing CreateTablet for tablet 966ce2c21a0a4a6cb65aaf5e0bfe8eac (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260807 13:40:25.793602 23881 ts_tablet_manager.cc:1397] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.214s user 0.012s sys 0.006s
I20260807 13:40:25.794181 23688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1e9a929f1fe4faeb8fc3a072191c41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.796200 23585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b213bed392294fcfb09b79938e6b85b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.744824 23803 tablet_service.cc:1467] Processing CreateTablet for tablet 8624086fc56b47cf914a4540b2ba3ae1 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260807 13:40:25.798494 23803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8624086fc56b47cf914a4540b2ba3ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.794898 23686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09c37fe84a4c44ef8aa1fa514c7179b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.808043 23694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8d8d3a6cd704602b71ac7d5122cf9cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.812197 23578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e285d5ba5024cee8ad635138ef44fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.792798 23582 tablet_service.cc:1467] Processing CreateTablet for tablet 7800087414314b9983dee88fd1b6ccb5 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260807 13:40:25.815680 23691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7800087414314b9983dee88fd1b6ccb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.817118 23696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e285d5ba5024cee8ad635138ef44fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.832639 23881 raft_consensus.cc:348] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
I20260807 13:40:25.833704 23881 raft_consensus.cc:374] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:25.841437 23881 raft_consensus.cc:729] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:25.842571 23881 consensus_queue.cc:260] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
I20260807 13:40:25.840560 23884 raft_consensus.cc:348] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
I20260807 13:40:25.844851 23884 raft_consensus.cc:374] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:25.845227 23884 raft_consensus.cc:729] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:25.846163 23884 consensus_queue.cc:260] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
I20260807 13:40:25.850611 23806 tablet_service.cc:1467] Processing CreateTablet for tablet d82ae8b5e643448f937e62d82bf888ff (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260807 13:40:25.856092 23806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d82ae8b5e643448f937e62d82bf888ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.846163 23698 tablet_service.cc:1467] Processing CreateTablet for tablet cf2e5e45fca749498a80852c430edb21 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260807 13:40:25.860050 23698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf2e5e45fca749498a80852c430edb21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.867650 23888 tablet_bootstrap.cc:654] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:25.879817 23579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09c37fe84a4c44ef8aa1fa514c7179b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.887171 23582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7800087414314b9983dee88fd1b6ccb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.887961 23580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed0a63d9cc9e4b7bad0c1d1a83f10228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.888726 23808 tablet_service.cc:1467] Processing CreateTablet for tablet 0dc716b3423f48deb7798cbf9e86d821 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260807 13:40:25.890095 23808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0dc716b3423f48deb7798cbf9e86d821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.892840 23586 tablet_service.cc:1467] Processing CreateTablet for tablet aa5fcc43292246d486ebba83eac423d6 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260807 13:40:25.904498 23587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 966ce2c21a0a4a6cb65aaf5e0bfe8eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.905622 23583 tablet_service.cc:1467] Processing CreateTablet for tablet a8d8d3a6cd704602b71ac7d5122cf9cf (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260807 13:40:25.925746 23752 heartbeater.cc:503] Master 127.21.82.126:40997 was elected leader, sending a full tablet report...
I20260807 13:40:25.924518 23896 raft_consensus.cc:482] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:25.939318 23896 raft_consensus.cc:504] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
I20260807 13:40:25.943609 23804 tablet_service.cc:1467] Processing CreateTablet for tablet 7985ff913681417583d257589c2e4020 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260807 13:40:25.944953 23804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7985ff913681417583d257589c2e4020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.957988 23582 tablet_service.cc:1467] Processing CreateTablet for tablet e1e9a929f1fe4faeb8fc3a072191c41a (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260807 13:40:25.959750 23884 ts_tablet_manager.cc:1428] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.170s user 0.007s sys 0.008s
I20260807 13:40:25.960836 23884 tablet_bootstrap.cc:492] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:25.963898 23584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 689213e52b434d3bb11b840c79916a65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.968214 23696 tablet_service.cc:1467] Processing CreateTablet for tablet 8624086fc56b47cf914a4540b2ba3ae1 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260807 13:40:25.970080 23696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8624086fc56b47cf914a4540b2ba3ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.970022 23801 tablet_service.cc:1467] Processing CreateTablet for tablet 4c6c66dd2185444995b276c0cf4000c8 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260807 13:40:25.972100 23801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c6c66dd2185444995b276c0cf4000c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:25.975741 23804 tablet_service.cc:1467] Processing CreateTablet for tablet 18a5485342aa448ba6cfe5f9c07eb43d (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260807 13:40:25.981400 23896 leader_election.cc:288] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685), 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187)
I20260807 13:40:25.985662 23638 heartbeater.cc:503] Master 127.21.82.126:40997 was elected leader, sending a full tablet report...
I20260807 13:40:25.988428 23688 tablet_service.cc:1467] Processing CreateTablet for tablet b8a6dd54ac4d4a8b9227a3d3ee9fafb6 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260807 13:40:26.001868 23586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa5fcc43292246d486ebba83eac423d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.015383 23863 heartbeater.cc:503] Master 127.21.82.126:40997 was elected leader, sending a full tablet report...
I20260807 13:40:26.015301 23889 raft_consensus.cc:482] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:26.016109 23889 raft_consensus.cc:504] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
I20260807 13:40:26.011487 23688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8a6dd54ac4d4a8b9227a3d3ee9fafb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.013353 23804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18a5485342aa448ba6cfe5f9c07eb43d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.030068 23583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8d8d3a6cd704602b71ac7d5122cf9cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.045684 23582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1e9a929f1fe4faeb8fc3a072191c41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.037740 23881 ts_tablet_manager.cc:1428] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.244s user 0.016s sys 0.027s
I20260807 13:40:26.042042 23889 leader_election.cc:288] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187)
W20260807 13:40:26.054782 23754 tablet.cc:2369] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 13:40:26.059146 23685 tablet_service.cc:1467] Processing CreateTablet for tablet d82ae8b5e643448f937e62d82bf888ff (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260807 13:40:26.060549 23685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d82ae8b5e643448f937e62d82bf888ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.060491 23811 tablet_service.cc:1467] Processing CreateTablet for tablet 7472ae891a234d26a82a6d485d983386 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260807 13:40:26.062096 23811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7472ae891a234d26a82a6d485d983386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.063531 23803 tablet_service.cc:1467] Processing CreateTablet for tablet 1d0fa316c27e4c899031825c69b57f1d (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260807 13:40:26.064755 23803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d0fa316c27e4c899031825c69b57f1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.069435 23888 tablet_bootstrap.cc:492] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:26.069941 23888 ts_tablet_manager.cc:1397] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.327s user 0.042s sys 0.043s
I20260807 13:40:26.071452 23881 tablet_bootstrap.cc:492] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:26.058005 23809 tablet_service.cc:1467] Processing CreateTablet for tablet 92e077211c2d4b67b9560872e943322f (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260807 13:40:26.073217 23809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92e077211c2d4b67b9560872e943322f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.076893 23585 tablet_service.cc:1467] Processing CreateTablet for tablet d82ae8b5e643448f937e62d82bf888ff (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260807 13:40:26.077862 23689 tablet_service.cc:1467] Processing CreateTablet for tablet 0dc716b3423f48deb7798cbf9e86d821 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260807 13:40:26.079586 23689 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0dc716b3423f48deb7798cbf9e86d821. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 13:40:26.107018 23429 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 53037.8us
I20260807 13:40:26.108603 23888 raft_consensus.cc:348] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:26.109536 23888 raft_consensus.cc:374] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:26.109879 23888 raft_consensus.cc:729] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:26.115427 23805 tablet_service.cc:1467] Processing CreateTablet for tablet a47d160dba334fd0a32cff0cfc2459c1 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260807 13:40:26.116801 23805 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a47d160dba334fd0a32cff0cfc2459c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.122375 23807 tablet_service.cc:1467] Processing CreateTablet for tablet 79f871ca72ef417aa877002c8166b44c (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260807 13:40:26.123862 23807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79f871ca72ef417aa877002c8166b44c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.133103 23884 tablet_bootstrap.cc:654] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:26.136196 23585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d82ae8b5e643448f937e62d82bf888ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.137036 23579 tablet_service.cc:1467] Processing CreateTablet for tablet 8624086fc56b47cf914a4540b2ba3ae1 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260807 13:40:26.138407 23579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8624086fc56b47cf914a4540b2ba3ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.138089 23802 tablet_service.cc:1467] Processing CreateTablet for tablet 3effc170900e450eb8126db59a299ab7 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260807 13:40:26.139503 23802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3effc170900e450eb8126db59a299ab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.150835 23578 tablet_service.cc:1467] Processing CreateTablet for tablet cf2e5e45fca749498a80852c430edb21 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260807 13:40:26.152839 23578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf2e5e45fca749498a80852c430edb21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.155871 23686 tablet_service.cc:1467] Processing CreateTablet for tablet 7985ff913681417583d257589c2e4020 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260807 13:40:26.156157 23695 tablet_service.cc:1467] Processing CreateTablet for tablet 4c6c66dd2185444995b276c0cf4000c8 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260807 13:40:26.157428 23686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7985ff913681417583d257589c2e4020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.188908 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:26.189824 23881 tablet_bootstrap.cc:654] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:26.189896 23825 raft_consensus.cc:2454] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:26.186285 23695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c6c66dd2185444995b276c0cf4000c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.110596 23888 consensus_queue.cc:260] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:26.197515 23660 leader_election.cc:302] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:26.198505 23808 tablet_service.cc:1467] Processing CreateTablet for tablet 6c61756fb1434eeaa0f728ccb1894def (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260807 13:40:26.199818 23692 tablet_service.cc:1467] Processing CreateTablet for tablet 18a5485342aa448ba6cfe5f9c07eb43d (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260807 13:40:26.214119 23581 tablet_service.cc:1467] Processing CreateTablet for tablet b8a6dd54ac4d4a8b9227a3d3ee9fafb6 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260807 13:40:26.227216 23896 raft_consensus.cc:2781] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:26.235078 23896 raft_consensus.cc:482] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:26.235503 23896 raft_consensus.cc:3037] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:26.236207 23692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18a5485342aa448ba6cfe5f9c07eb43d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.237298 23581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8a6dd54ac4d4a8b9227a3d3ee9fafb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.229624 23580 tablet_service.cc:1467] Processing CreateTablet for tablet 0dc716b3423f48deb7798cbf9e86d821 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260807 13:40:26.249284 23580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0dc716b3423f48deb7798cbf9e86d821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.231467 23808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c61756fb1434eeaa0f728ccb1894def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.281169 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:26.283577 23662 leader_election.cc:341] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:26.211861 23698 tablet_service.cc:1467] Processing CreateTablet for tablet 1d0fa316c27e4c899031825c69b57f1d (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260807 13:40:26.296387 23586 tablet_service.cc:1467] Processing CreateTablet for tablet 4c6c66dd2185444995b276c0cf4000c8 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260807 13:40:26.298990 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:26.299502 23586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c6c66dd2185444995b276c0cf4000c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.305155 23884 tablet_bootstrap.cc:492] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:26.305692 23884 ts_tablet_manager.cc:1397] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.345s user 0.017s sys 0.010s
I20260807 13:40:26.308691 23884 raft_consensus.cc:348] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:26.309509 23884 raft_consensus.cc:374] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:26.309851 23884 raft_consensus.cc:729] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:26.310804 23884 consensus_queue.cc:260] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:26.313671 23884 ts_tablet_manager.cc:1428] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260807 13:40:26.317968 23587 tablet_service.cc:1467] Processing CreateTablet for tablet 18a5485342aa448ba6cfe5f9c07eb43d (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260807 13:40:26.323297 23583 tablet_service.cc:1467] Processing CreateTablet for tablet 7985ff913681417583d257589c2e4020 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260807 13:40:26.325027 23691 tablet_service.cc:1467] Processing CreateTablet for tablet 92e077211c2d4b67b9560872e943322f (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260807 13:40:26.325662 23806 tablet_service.cc:1467] Processing CreateTablet for tablet 1ce8e1212162485cb6c2d7c393e99399 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260807 13:40:26.351553 23806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ce8e1212162485cb6c2d7c393e99399. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.343753 23888 ts_tablet_manager.cc:1428] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.274s user 0.014s sys 0.019s
I20260807 13:40:26.287365 23896 raft_consensus.cc:504] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
I20260807 13:40:26.346319 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:26.352659 23694 tablet_service.cc:1467] Processing CreateTablet for tablet 7472ae891a234d26a82a6d485d983386 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260807 13:40:26.353471 23711 raft_consensus.cc:2379] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 1: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
W20260807 13:40:26.353765 23772 leader_election.cc:341] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:26.350508 23587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18a5485342aa448ba6cfe5f9c07eb43d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.336534 23578 tablet_service.cc:1467] Processing CreateTablet for tablet 1d0fa316c27e4c899031825c69b57f1d (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260807 13:40:26.353948 23694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7472ae891a234d26a82a6d485d983386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.355643 23578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d0fa316c27e4c899031825c69b57f1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.358074 23696 tablet_service.cc:1467] Processing CreateTablet for tablet a47d160dba334fd0a32cff0cfc2459c1 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260807 13:40:26.361200 23688 tablet_service.cc:1467] Processing CreateTablet for tablet 79f871ca72ef417aa877002c8166b44c (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260807 13:40:26.363081 23769 leader_election.cc:302] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:26.363166 23811 tablet_service.cc:1467] Processing CreateTablet for tablet e870c19541754909a8880cfcb379933c (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260807 13:40:26.364355 23889 raft_consensus.cc:3037] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:26.364503 23811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e870c19541754909a8880cfcb379933c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.364732 23888 tablet_bootstrap.cc:492] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:26.361304 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:26.347008 23582 tablet_service.cc:1467] Processing CreateTablet for tablet 92e077211c2d4b67b9560872e943322f (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260807 13:40:26.375981 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:26.350538 23584 tablet_service.cc:1467] Processing CreateTablet for tablet 7472ae891a234d26a82a6d485d983386 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260807 13:40:26.376751 23888 tablet_bootstrap.cc:654] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:26.370993 23801 tablet_service.cc:1467] Processing CreateTablet for tablet daaea1dffb5443f4858c40ca25e7830e (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260807 13:40:26.385185 23884 tablet_bootstrap.cc:492] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
W20260807 13:40:26.385073 23662 leader_election.cc:341] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:26.379875 23583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7985ff913681417583d257589c2e4020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.386610 23685 tablet_service.cc:1467] Processing CreateTablet for tablet 6c61756fb1434eeaa0f728ccb1894def (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260807 13:40:26.386894 23801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet daaea1dffb5443f4858c40ca25e7830e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.389904 23582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92e077211c2d4b67b9560872e943322f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.390307 23809 tablet_service.cc:1467] Processing CreateTablet for tablet 4f2c88606c274605948654e7a33c9982 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260807 13:40:26.391088 23584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7472ae891a234d26a82a6d485d983386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.386361 23692 tablet_service.cc:1467] Processing CreateTablet for tablet 3effc170900e450eb8126db59a299ab7 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260807 13:40:26.377750 23896 leader_election.cc:288] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Requested vote from peers d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685), 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187)
I20260807 13:40:26.400379 23585 tablet_service.cc:1467] Processing CreateTablet for tablet a47d160dba334fd0a32cff0cfc2459c1 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260807 13:40:26.401772 23585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a47d160dba334fd0a32cff0cfc2459c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.415452 23889 raft_consensus.cc:2726] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:26.391621 23809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f2c88606c274605948654e7a33c9982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.405124 23688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79f871ca72ef417aa877002c8166b44c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.433854 23805 tablet_service.cc:1467] Processing CreateTablet for tablet 2133139b13ce49de9c5a382720699163 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260807 13:40:26.433769 23804 tablet_service.cc:1467] Processing CreateTablet for tablet 31124698024d476f89cdf788d21e50b7 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260807 13:40:26.435506 23825 raft_consensus.cc:2454] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:26.437384 23660 leader_election.cc:302] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:26.437345 23686 tablet_service.cc:1467] Processing CreateTablet for tablet daaea1dffb5443f4858c40ca25e7830e (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260807 13:40:26.437688 23888 tablet_bootstrap.cc:492] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:26.438689 23896 raft_consensus.cc:2781] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:26.438706 23888 ts_tablet_manager.cc:1397] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.074s user 0.007s sys 0.009s
I20260807 13:40:26.439229 23896 raft_consensus.cc:686] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:26.440127 23896 consensus_queue.cc:237] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
I20260807 13:40:26.429018 23689 tablet_service.cc:1467] Processing CreateTablet for tablet 1ce8e1212162485cb6c2d7c393e99399 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260807 13:40:26.448506 23806 tablet_service.cc:1467] Processing CreateTablet for tablet fd31593673b040a184ccd6160a9674de (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260807 13:40:26.451239 23804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31124698024d476f89cdf788d21e50b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.452332 23888 raft_consensus.cc:348] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:26.453110 23888 raft_consensus.cc:374] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:26.453414 23888 raft_consensus.cc:729] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:26.454242 23805 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2133139b13ce49de9c5a382720699163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.457808 23695 tablet_service.cc:1467] Processing CreateTablet for tablet e870c19541754909a8880cfcb379933c (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260807 13:40:26.466560 23584 tablet_service.cc:1467] Processing CreateTablet for tablet 79f871ca72ef417aa877002c8166b44c (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260807 13:40:26.469517 23584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79f871ca72ef417aa877002c8166b44c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.472942 23806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd31593673b040a184ccd6160a9674de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.483177 23580 tablet_service.cc:1467] Processing CreateTablet for tablet 6c61756fb1434eeaa0f728ccb1894def (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260807 13:40:26.515868 23580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c61756fb1434eeaa0f728ccb1894def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.516942 23807 tablet_service.cc:1467] Processing CreateTablet for tablet 9ccbe9b13e784aaca48d07dff333695a (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260807 13:40:26.483836 23888 consensus_queue.cc:260] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:26.524595 23888 ts_tablet_manager.cc:1428] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.077s user 0.004s sys 0.001s
I20260807 13:40:26.525647 23888 tablet_bootstrap.cc:492] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:26.530889 23809 tablet_service.cc:1467] Processing CreateTablet for tablet 910844a7b519444faad288ab2098a066 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260807 13:40:26.488039 23881 tablet_bootstrap.cc:492] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:26.489403 23585 tablet_service.cc:1467] Processing CreateTablet for tablet 3effc170900e450eb8126db59a299ab7 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260807 13:40:26.534065 23585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3effc170900e450eb8126db59a299ab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.487409 23801 tablet_service.cc:1467] Processing CreateTablet for tablet e912486c065f413cb2657340dc9a95af (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260807 13:40:26.494179 23884 tablet_bootstrap.cc:654] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:26.494778 23698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d0fa316c27e4c899031825c69b57f1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.542496 23696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a47d160dba334fd0a32cff0cfc2459c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.543246 23685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c61756fb1434eeaa0f728ccb1894def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.543933 23686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet daaea1dffb5443f4858c40ca25e7830e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.546432 23580 tablet_service.cc:1467] Processing CreateTablet for tablet 2133139b13ce49de9c5a382720699163 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260807 13:40:26.502815 23584 tablet_service.cc:1467] Processing CreateTablet for tablet daaea1dffb5443f4858c40ca25e7830e (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260807 13:40:26.550961 23584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet daaea1dffb5443f4858c40ca25e7830e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.497627 23583 tablet_service.cc:1467] Processing CreateTablet for tablet e870c19541754909a8880cfcb379933c (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260807 13:40:26.513479 23805 tablet_service.cc:1467] Processing CreateTablet for tablet 72d879feba30417e9919fc152b543506 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260807 13:40:26.475878 23803 tablet_service.cc:1467] Processing CreateTablet for tablet f46f16bbd2f64224b67d0da4707f8f2f (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260807 13:40:26.555961 23583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e870c19541754909a8880cfcb379933c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.546995 23692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3effc170900e450eb8126db59a299ab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.556932 23691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92e077211c2d4b67b9560872e943322f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.549466 23881 ts_tablet_manager.cc:1397] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.478s user 0.011s sys 0.005s
I20260807 13:40:26.562503 23579 tablet_service.cc:1467] Processing CreateTablet for tablet f46f16bbd2f64224b67d0da4707f8f2f (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260807 13:40:26.563951 23579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f46f16bbd2f64224b67d0da4707f8f2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.503997 23582 tablet_service.cc:1467] Processing CreateTablet for tablet 1ce8e1212162485cb6c2d7c393e99399 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260807 13:40:26.565188 23582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ce8e1212162485cb6c2d7c393e99399. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.572355 23909 raft_consensus.cc:482] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:26.573278 23909 raft_consensus.cc:504] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:26.569526 23695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e870c19541754909a8880cfcb379933c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.574119 23807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ccbe9b13e784aaca48d07dff333695a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.578800 23803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f46f16bbd2f64224b67d0da4707f8f2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.579149 23909 leader_election.cc:288] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:26.579433 23809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 910844a7b519444faad288ab2098a066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.588763 23801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e912486c065f413cb2657340dc9a95af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.590817 23884 tablet_bootstrap.cc:492] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:26.591411 23884 ts_tablet_manager.cc:1397] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.206s user 0.026s sys 0.003s
I20260807 13:40:26.592723 23811 tablet_service.cc:1467] Processing CreateTablet for tablet 898f2485bfe34aa296ddf8f5c5cfb5ca (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260807 13:40:26.594177 23811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 898f2485bfe34aa296ddf8f5c5cfb5ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.601219 23449 catalog_manager.cc:5495] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 1 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:26.590957 23802 tablet_service.cc:1467] Processing CreateTablet for tablet ab56376b2d7c4e52826236ef52452731 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260807 13:40:26.572358 23881 raft_consensus.cc:348] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:26.607726 23580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2133139b13ce49de9c5a382720699163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.605400 23689 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ce8e1212162485cb6c2d7c393e99399. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.612784 23881 raft_consensus.cc:374] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:26.620071 23805 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72d879feba30417e9919fc152b543506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.626505 23888 tablet_bootstrap.cc:654] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:26.632480 23581 tablet_service.cc:1467] Processing CreateTablet for tablet 31124698024d476f89cdf788d21e50b7 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260807 13:40:26.594442 23884 raft_consensus.cc:348] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:26.644173 23808 tablet_service.cc:1467] Processing CreateTablet for tablet 7c1184114b02410098331e68d3b8d4cf (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260807 13:40:26.648572 23802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab56376b2d7c4e52826236ef52452731. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.653254 23688 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47664 (request call id 33) took 1019 ms. Trace:
I20260807 13:40:26.654001 23688 rpcz_store.cc:276] 0807 13:40:25.633898 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.360354 (+726456us) service_pool.cc:227] Handling call
0807 13:40:26.361981 (+ 1627us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.362064 (+ 83us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:26.644703 (+282639us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:26.652730 (+ 8027us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:26.653189 (+ 459us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:26.657094 23884 raft_consensus.cc:374] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:26.657439 23884 raft_consensus.cc:729] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:26.658190 23884 consensus_queue.cc:260] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:26.660552 23884 ts_tablet_manager.cc:1428] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.069s user 0.004s sys 0.003s
I20260807 13:40:26.661531 23884 tablet_bootstrap.cc:492] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:26.668306 23884 tablet_bootstrap.cc:654] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:26.620085 23881 raft_consensus.cc:729] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:26.669546 23881 consensus_queue.cc:260] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:26.679952 23586 tablet_service.cc:1467] Processing CreateTablet for tablet 4f2c88606c274605948654e7a33c9982 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260807 13:40:26.681391 23586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f2c88606c274605948654e7a33c9982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.679131 23808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c1184114b02410098331e68d3b8d4cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.686847 23881 ts_tablet_manager.cc:1428] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.126s user 0.004s sys 0.004s
I20260807 13:40:26.688038 23881 tablet_bootstrap.cc:492] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:26.689967 23896 raft_consensus.cc:482] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:26.690443 23896 raft_consensus.cc:504] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:26.692608 23896 leader_election.cc:288] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:26.694167 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:26.695689 23660 leader_election.cc:341] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:26.695546 23585 tablet_service.cc:1467] Processing CreateTablet for tablet fd31593673b040a184ccd6160a9674de (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260807 13:40:26.682348 23587 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43804 (request call id 28) took 1042 ms. Trace:
I20260807 13:40:26.696766 23801 tablet_service.cc:1467] Processing CreateTablet for tablet fbac6e18ecd14ba2a7d3e846a9fc81bf (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260807 13:40:26.696962 23587 rpcz_store.cc:276] 0807 13:40:25.636904 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.316970 (+680066us) service_pool.cc:227] Handling call
0807 13:40:26.350005 (+ 33035us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.350107 (+ 102us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:26.465584 (+115477us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:26.667076 (+201492us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:26.679237 (+ 12161us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:26.699003 23587 tablet_service.cc:1467] Processing CreateTablet for tablet e912486c065f413cb2657340dc9a95af (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260807 13:40:26.703739 23804 tablet_service.cc:1467] Processing CreateTablet for tablet 830e8cb8ce434e6391c09530c677a61d (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260807 13:40:26.705214 23804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 830e8cb8ce434e6391c09530c677a61d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.711918 23578 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43804 (request call id 29) took 1074 ms. Trace:
I20260807 13:40:26.711788 23584 tablet_service.cc:1467] Processing CreateTablet for tablet 72d879feba30417e9919fc152b543506 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260807 13:40:26.712502 23578 rpcz_store.cc:276] 0807 13:40:25.637245 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.335562 (+698317us) service_pool.cc:227] Handling call
0807 13:40:26.355049 (+ 19487us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.355190 (+ 141us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:26.505023 (+149833us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:26.711176 (+206153us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:26.711803 (+ 627us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:26.714509 23578 tablet_service.cc:1467] Processing CreateTablet for tablet 9ccbe9b13e784aaca48d07dff333695a (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260807 13:40:26.716409 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:26.717691 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:26.738039 23554 leader_election.cc:341] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:40:26.738515 23662 leader_election.cc:341] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:26.720458 23888 tablet_bootstrap.cc:492] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:26.738972 23662 leader_election.cc:302] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:26.739405 23888 ts_tablet_manager.cc:1397] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.214s user 0.013s sys 0.008s
I20260807 13:40:26.739949 23890 raft_consensus.cc:2726] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:26.722985 23581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31124698024d476f89cdf788d21e50b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.742808 23803 tablet_service.cc:1467] Processing CreateTablet for tablet c9552d42b445450691daef21fba4059a (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260807 13:40:26.744442 23803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9552d42b445450691daef21fba4059a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.658150 23688 tablet_service.cc:1467] Processing CreateTablet for tablet 2133139b13ce49de9c5a382720699163 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260807 13:40:26.733777 23691 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47664 (request call id 30) took 1139 ms. Trace:
I20260807 13:40:26.735400 23806 tablet_service.cc:1467] Processing CreateTablet for tablet 68ed0b32f1864122a6a9a014c0217c01 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260807 13:40:26.736022 23896 raft_consensus.cc:482] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:26.736450 23583 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43804 (request call id 36) took 1024 ms. Trace:
I20260807 13:40:26.744299 23811 tablet_service.cc:1467] Processing CreateTablet for tablet e4d6a524bccf4e4a98f503c584d91cb3 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260807 13:40:26.763938 23583 rpcz_store.cc:276] 0807 13:40:25.712173 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.494472 (+782299us) service_pool.cc:227] Handling call
0807 13:40:26.555187 (+ 60715us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.555529 (+ 342us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:26.580254 (+ 24725us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:26.735922 (+155668us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:26.736388 (+ 466us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:26.764757 23811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4d6a524bccf4e4a98f503c584d91cb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.765914 23583 tablet_service.cc:1467] Processing CreateTablet for tablet 910844a7b519444faad288ab2098a066 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260807 13:40:26.745873 23809 tablet_service.cc:1467] Processing CreateTablet for tablet f299697fb7db462dad6c590a8cfea499 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260807 13:40:26.766785 23896 raft_consensus.cc:504] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:26.767524 23809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f299697fb7db462dad6c590a8cfea499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.768978 23896 leader_election.cc:288] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:26.770402 23688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2133139b13ce49de9c5a382720699163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.725423 23698 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47664 (request call id 29) took 1147 ms. Trace:
I20260807 13:40:26.770701 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:26.771273 23806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68ed0b32f1864122a6a9a014c0217c01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.771167 23698 rpcz_store.cc:276] 0807 13:40:25.578272 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.210511 (+632239us) service_pool.cc:227] Handling call
0807 13:40:26.381172 (+170661us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.382811 (+ 1639us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:26.553235 (+170424us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:26.724859 (+171624us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:26.725358 (+ 499us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:40:26.772186 23660 leader_election.cc:341] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:26.773195 23698 tablet_service.cc:1467] Processing CreateTablet for tablet f46f16bbd2f64224b67d0da4707f8f2f (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260807 13:40:26.759855 23691 rpcz_store.cc:276] 0807 13:40:25.594760 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.324072 (+729312us) service_pool.cc:227] Handling call
0807 13:40:26.381322 (+ 57250us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.385957 (+ 4635us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:26.676147 (+290190us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:26.733180 (+ 57033us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:26.733712 (+ 532us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:26.747052 23578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ccbe9b13e784aaca48d07dff333695a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.751004 23582 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43804 (request call id 37) took 1014 ms. Trace:
I20260807 13:40:26.778784 23582 rpcz_store.cc:276] 0807 13:40:25.736362 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.495853 (+759491us) service_pool.cc:227] Handling call
0807 13:40:26.564642 (+ 68789us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.564788 (+ 146us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:26.699312 (+134524us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:26.730486 (+ 31174us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:26.750943 (+ 20457us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:26.780465 23801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbac6e18ecd14ba2a7d3e846a9fc81bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.780679 23582 tablet_service.cc:1467] Processing CreateTablet for tablet e4d6a524bccf4e4a98f503c584d91cb3 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260807 13:40:26.781242 23807 tablet_service.cc:1467] Processing CreateTablet for tablet 1f8a5f186bf1473a988921e5efa3e574 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260807 13:40:26.781700 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:26.782423 23601 raft_consensus.cc:2454] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:26.742379 23888 raft_consensus.cc:348] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:26.774612 23698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f46f16bbd2f64224b67d0da4707f8f2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.782537 23807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f8a5f186bf1473a988921e5efa3e574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.758226 23685 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47664 (request call id 35) took 1070 ms. Trace:
I20260807 13:40:26.784578 23888 raft_consensus.cc:374] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:26.795039 23888 raft_consensus.cc:729] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:26.776733 23691 tablet_service.cc:1467] Processing CreateTablet for tablet 4f2c88606c274605948654e7a33c9982 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260807 13:40:26.796602 23691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f2c88606c274605948654e7a33c9982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.796048 23888 consensus_queue.cc:260] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:26.796343 23802 tablet_service.cc:1467] Processing CreateTablet for tablet 0f4062e0223a4cc0b2e448e35445671d (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260807 13:40:26.779721 23580 tablet_service.cc:1467] Processing CreateTablet for tablet 68ed0b32f1864122a6a9a014c0217c01 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260807 13:40:26.787597 23585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd31593673b040a184ccd6160a9674de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.787506 23662 leader_election.cc:302] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:26.804944 23802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f4062e0223a4cc0b2e448e35445671d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.807480 23587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e912486c065f413cb2657340dc9a95af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.811558 23584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72d879feba30417e9919fc152b543506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.807977 23896 raft_consensus.cc:2781] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:26.816080 23896 raft_consensus.cc:482] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:26.816481 23896 raft_consensus.cc:3037] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:26.816798 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:26.803622 23888 ts_tablet_manager.cc:1428] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.064s user 0.006s sys 0.002s
I20260807 13:40:26.817555 23694 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47664 (request call id 31) took 1193 ms. Trace:
I20260807 13:40:26.786475 23689 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47664 (request call id 37) took 1047 ms. Trace:
I20260807 13:40:26.763667 23695 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47664 (request call id 36) took 1050 ms. Trace:
I20260807 13:40:26.817916 23685 rpcz_store.cc:276] 0807 13:40:25.688112 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.382808 (+694696us) service_pool.cc:227] Handling call
0807 13:40:26.389813 (+ 7005us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.389913 (+ 100us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:26.698705 (+308792us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:26.746287 (+ 47582us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:26.757457 (+ 11170us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:26.817960 23694 rpcz_store.cc:276] 0807 13:40:25.623718 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.351157 (+727439us) service_pool.cc:227] Handling call
0807 13:40:26.353461 (+ 2304us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.353555 (+ 94us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:26.705053 (+351498us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:26.817029 (+111976us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:26.817493 (+ 464us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:26.833315 23582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4d6a524bccf4e4a98f503c584d91cb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.840346 23686 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47664 (request call id 38) took 1092 ms. Trace:
I20260807 13:40:26.840910 23686 rpcz_store.cc:276] 0807 13:40:25.748431 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.436458 (+688027us) service_pool.cc:227] Handling call
0807 13:40:26.438202 (+ 1744us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.438291 (+ 89us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:26.636987 (+198696us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:26.839817 (+202830us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:26.840276 (+ 459us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":28}
I20260807 13:40:26.829155 23881 tablet_bootstrap.cc:654] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:26.844426 23692 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47664 (request call id 34) took 1185 ms. Trace:
I20260807 13:40:26.823485 23695 rpcz_store.cc:276] 0807 13:40:25.712928 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.405659 (+692731us) service_pool.cc:227] Handling call
0807 13:40:26.474944 (+ 69285us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.475050 (+ 106us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:26.629598 (+154548us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:26.733247 (+103649us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:26.760289 (+ 27042us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7}
I20260807 13:40:26.857889 23909 raft_consensus.cc:482] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:26.858453 23909 raft_consensus.cc:504] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:26.860689 23695 tablet_service.cc:1467] Processing CreateTablet for tablet 72d879feba30417e9919fc152b543506 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260807 13:40:26.861886 23909 leader_election.cc:288] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:26.862943 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:26.864710 23555 leader_election.cc:341] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:26.867277 23695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72d879feba30417e9919fc152b543506. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 13:40:26.868163 23535 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:40:26.868935 23583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 910844a7b519444faad288ab2098a066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.870551 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:26.866472 23579 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43804 (request call id 40) took 1100 ms. Trace:
I20260807 13:40:26.871562 23579 rpcz_store.cc:276] 0807 13:40:25.765933 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.561558 (+795625us) service_pool.cc:227] Handling call
0807 13:40:26.563458 (+ 1900us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.563560 (+ 102us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:26.703582 (+140022us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:26.851265 (+147683us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:26.866409 (+ 15144us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1103}
W20260807 13:40:26.872160 23554 leader_election.cc:341] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:26.844611 23686 tablet_service.cc:1467] Processing CreateTablet for tablet 31124698024d476f89cdf788d21e50b7 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260807 13:40:26.819840 23689 rpcz_store.cc:276] 0807 13:40:25.738939 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.428094 (+689155us) service_pool.cc:227] Handling call
0807 13:40:26.447277 (+ 19183us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.447981 (+ 704us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:26.684071 (+236090us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:26.775065 (+ 90994us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:26.786008 (+ 10943us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:26.858779 23696 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47664 (request call id 32) took 1231 ms. Trace:
I20260807 13:40:26.876816 23579 tablet_service.cc:1467] Processing CreateTablet for tablet 830e8cb8ce434e6391c09530c677a61d (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260807 13:40:26.886493 23694 tablet_service.cc:1467] Processing CreateTablet for tablet e912486c065f413cb2657340dc9a95af (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260807 13:40:26.887323 23884 tablet_bootstrap.cc:492] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:26.890563 23698 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47664 (request call id 40) took 1120 ms. Trace:
I20260807 13:40:26.921617 23698 rpcz_store.cc:276] 0807 13:40:25.769888 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.772256 (+1002368us) service_pool.cc:227] Handling call
0807 13:40:26.774108 (+ 1852us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.774210 (+ 102us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:26.882989 (+108779us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:26.889951 (+ 6962us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:26.890495 (+ 544us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:26.899186 23888 tablet_bootstrap.cc:492] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:26.922741 23686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31124698024d476f89cdf788d21e50b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.922909 23884 ts_tablet_manager.cc:1397] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.262s user 0.018s sys 0.020s
I20260807 13:40:26.891993 23580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68ed0b32f1864122a6a9a014c0217c01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.924059 23694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e912486c065f413cb2657340dc9a95af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.932125 23889 raft_consensus.cc:482] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:26.932732 23889 raft_consensus.cc:504] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:26.932646 23696 rpcz_store.cc:276] 0807 13:40:25.625821 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.357185 (+731364us) service_pool.cc:227] Handling call
0807 13:40:26.358926 (+ 1741us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.367542 (+ 8616us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:26.739180 (+371638us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:26.839407 (+100227us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:26.857331 (+ 17924us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:26.945248 23889 leader_election.cc:288] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:26.946854 23689 tablet_service.cc:1467] Processing CreateTablet for tablet 9ccbe9b13e784aaca48d07dff333695a (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260807 13:40:26.947446 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:26.948691 23689 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ccbe9b13e784aaca48d07dff333695a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.911953 23685 tablet_service.cc:1467] Processing CreateTablet for tablet fd31593673b040a184ccd6160a9674de (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260807 13:40:26.952342 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:26.952209 23698 tablet_service.cc:1467] Processing CreateTablet for tablet ab56376b2d7c4e52826236ef52452731 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260807 13:40:26.953210 23601 raft_consensus.cc:2454] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:26.953289 23581 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43804 (request call id 42) took 1175 ms. Trace:
I20260807 13:40:26.891734 23554 leader_election.cc:302] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:26.957221 23909 raft_consensus.cc:2726] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 13:40:26.957425 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 85298.9us
I20260807 13:40:26.957839 23579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 830e8cb8ce434e6391c09530c677a61d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.959112 23583 tablet_service.cc:1467] Processing CreateTablet for tablet ab56376b2d7c4e52826236ef52452731 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260807 13:40:26.961285 23583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab56376b2d7c4e52826236ef52452731. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.955719 23772 leader_election.cc:302] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
W20260807 13:40:26.964324 23769 leader_election.cc:341] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:26.953899 23581 rpcz_store.cc:276] 0807 13:40:25.777638 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.606946 (+829308us) service_pool.cc:227] Handling call
0807 13:40:26.675562 (+ 68616us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.678001 (+ 2439us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:26.782934 (+104933us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:26.952468 (+169534us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:26.953226 (+ 758us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:26.966989 23889 raft_consensus.cc:2781] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:26.967557 23889 raft_consensus.cc:482] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:26.968134 23889 raft_consensus.cc:3037] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:26.968370 23581 tablet_service.cc:1467] Processing CreateTablet for tablet 898f2485bfe34aa296ddf8f5c5cfb5ca (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260807 13:40:26.930148 23884 raft_consensus.cc:348] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:26.899313 23896 raft_consensus.cc:504] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:26.971107 23884 raft_consensus.cc:374] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:26.971745 23884 raft_consensus.cc:729] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:26.972273 23711 raft_consensus.cc:2379] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 1: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:26.952226 23685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd31593673b040a184ccd6160a9674de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.973752 23581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 898f2485bfe34aa296ddf8f5c5cfb5ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.850732 23692 rpcz_store.cc:276] 0807 13:40:25.658959 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.378709 (+719750us) service_pool.cc:227] Handling call
0807 13:40:26.393878 (+ 15169us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.393988 (+ 110us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:26.731372 (+337384us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:26.843895 (+112523us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:26.844365 (+ 470us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:26.982053 23698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab56376b2d7c4e52826236ef52452731. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.982685 23696 tablet_service.cc:1467] Processing CreateTablet for tablet 910844a7b519444faad288ab2098a066 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260807 13:40:26.985284 23696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 910844a7b519444faad288ab2098a066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.983107 23555 leader_election.cc:302] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:26.987092 23909 raft_consensus.cc:3037] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:26.994444 23692 tablet_service.cc:1467] Processing CreateTablet for tablet 898f2485bfe34aa296ddf8f5c5cfb5ca (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260807 13:40:26.997165 23692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 898f2485bfe34aa296ddf8f5c5cfb5ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:26.975777 23578 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43804 (request call id 46) took 1034 ms. Trace:
I20260807 13:40:27.000321 23881 tablet_bootstrap.cc:492] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:27.003386 23881 ts_tablet_manager.cc:1397] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.316s user 0.020s sys 0.004s
I20260807 13:40:26.989897 23884 consensus_queue.cc:260] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.010852 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:27.011508 23896 leader_election.cc:288] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:27.002851 23578 rpcz_store.cc:276] 0807 13:40:25.941717 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.713591 (+771874us) service_pool.cc:227] Handling call
0807 13:40:26.737121 (+ 23530us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.737227 (+ 106us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:26.891287 (+154060us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:26.964432 (+ 73145us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:26.975309 (+ 10877us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:27.014161 23884 ts_tablet_manager.cc:1428] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.090s user 0.008s sys 0.003s
I20260807 13:40:27.014225 23578 tablet_service.cc:1467] Processing CreateTablet for tablet 7c1184114b02410098331e68d3b8d4cf (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260807 13:40:27.015210 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:27.021348 23578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c1184114b02410098331e68d3b8d4cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:27.021817 23888 tablet_bootstrap.cc:654] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:27.015607 23586 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43804 (request call id 41) took 1241 ms. Trace:
I20260807 13:40:27.018924 23884 tablet_bootstrap.cc:492] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:27.018406 23881 raft_consensus.cc:348] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:27.025619 23660 leader_election.cc:341] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:27.023428 23586 rpcz_store.cc:276] 0807 13:40:25.772877 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.586915 (+814038us) service_pool.cc:227] Handling call
0807 13:40:26.680902 (+ 93987us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.681002 (+ 100us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:26.921144 (+240142us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:27.001061 (+ 79917us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:27.014335 (+ 13274us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:27.032253 23909 raft_consensus.cc:2726] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:27.027129 23896 consensus_queue.cc:1035] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260807 13:40:27.036331 23582 tablet_service.cc:1467] Processing CreateTablet for tablet fbac6e18ecd14ba2a7d3e846a9fc81bf (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260807 13:40:27.039083 23582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbac6e18ecd14ba2a7d3e846a9fc81bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:27.039683 23601 raft_consensus.cc:2454] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:27.042024 23662 leader_election.cc:302] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:27.037971 23585 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43804 (request call id 43) took 1171 ms. Trace:
I20260807 13:40:27.043246 23896 raft_consensus.cc:2781] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:27.043859 23896 raft_consensus.cc:686] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:27.044739 23896 consensus_queue.cc:237] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.043309 23585 rpcz_store.cc:276] 0807 13:40:25.866965 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.685391 (+818426us) service_pool.cc:227] Handling call
0807 13:40:26.696403 (+ 11012us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.696507 (+ 104us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:26.956042 (+259535us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:27.037459 (+ 81417us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:27.037914 (+ 455us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:27.049302 23586 tablet_service.cc:1467] Processing CreateTablet for tablet f299697fb7db462dad6c590a8cfea499 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260807 13:40:27.059532 23586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f299697fb7db462dad6c590a8cfea499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:27.051520 23585 tablet_service.cc:1467] Processing CreateTablet for tablet c9552d42b445450691daef21fba4059a (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260807 13:40:27.026129 23881 raft_consensus.cc:374] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:27.061475 23881 raft_consensus.cc:729] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:27.062539 23881 consensus_queue.cc:260] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.045912 23691 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47664 (request call id 41) took 1271 ms. Trace:
I20260807 13:40:27.070852 23691 rpcz_store.cc:276] 0807 13:40:25.774276 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.775825 (+1001549us) service_pool.cc:227] Handling call
0807 13:40:26.795966 (+ 20141us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.796120 (+ 154us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:26.924678 (+128558us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:27.045384 (+120706us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:27.045858 (+ 474us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:27.078956 23691 tablet_service.cc:1467] Processing CreateTablet for tablet 7c1184114b02410098331e68d3b8d4cf (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260807 13:40:27.080346 23691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c1184114b02410098331e68d3b8d4cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:27.085886 23688 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47664 (request call id 39) took 1328 ms. Trace:
I20260807 13:40:27.087978 23889 raft_consensus.cc:504] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:27.092981 23662 consensus_peers.cc:487] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 -> Peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Couldn't send request to peer 08757cfbeffb41bbab14c2ef00e9d812. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:40:27.113054 23583 tablet_service.cc:1467] Processing CreateTablet for tablet 1f8a5f186bf1473a988921e5efa3e574 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260807 13:40:27.115841 23889 leader_election.cc:288] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:27.115967 23580 tablet_service.cc:1467] Processing CreateTablet for tablet 0f4062e0223a4cc0b2e448e35445671d (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260807 13:40:27.117210 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
W20260807 13:40:27.119342 23769 leader_election.cc:341] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:27.119782 23689 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47664 (request call id 46) took 1152 ms. Trace:
I20260807 13:40:27.120185 23689 rpcz_store.cc:276] 0807 13:40:25.967539 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.930056 (+962517us) service_pool.cc:227] Handling call
0807 13:40:26.948002 (+ 17946us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.948141 (+ 139us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:27.057617 (+109476us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:27.119184 (+ 61567us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:27.119708 (+ 524us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:27.120688 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:27.121345 23601 raft_consensus.cc:3037] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:27.122166 23587 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43804 (request call id 44) took 1240 ms. Trace:
I20260807 13:40:27.089811 23688 rpcz_store.cc:276] 0807 13:40:25.757816 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.657205 (+899389us) service_pool.cc:227] Handling call
0807 13:40:26.769902 (+112697us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.770007 (+ 105us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:27.016971 (+246964us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:27.085266 (+ 68295us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:27.085809 (+ 543us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:27.128412 23688 tablet_service.cc:1467] Processing CreateTablet for tablet fbac6e18ecd14ba2a7d3e846a9fc81bf (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260807 13:40:27.122598 23587 rpcz_store.cc:276] 0807 13:40:25.886595 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.698100 (+811505us) service_pool.cc:227] Handling call
0807 13:40:26.699944 (+ 1844us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.700043 (+ 99us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:27.037734 (+337691us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:27.121661 (+ 83927us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:27.122108 (+ 447us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:27.122105 23689 tablet_service.cc:1467] Processing CreateTablet for tablet 830e8cb8ce434e6391c09530c677a61d (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260807 13:40:27.130602 23584 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43804 (request call id 45) took 1193 ms. Trace:
I20260807 13:40:27.131053 23584 rpcz_store.cc:276] 0807 13:40:25.937194 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.710875 (+773681us) service_pool.cc:227] Handling call
0807 13:40:26.712707 (+ 1832us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.712823 (+ 116us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:27.038993 (+326170us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:27.077687 (+ 38694us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:27.130544 (+ 52857us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:27.132179 23585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9552d42b445450691daef21fba4059a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:27.135552 23884 tablet_bootstrap.cc:654] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:27.137858 23601 raft_consensus.cc:2454] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:27.141810 23580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f4062e0223a4cc0b2e448e35445671d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:27.142448 23583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f8a5f186bf1473a988921e5efa3e574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:27.161056 23772 leader_election.cc:302] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:27.162694 23926 raft_consensus.cc:2781] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:27.164134 23926 raft_consensus.cc:686] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:27.165073 23926 consensus_queue.cc:237] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.168813 23696 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47664 (request call id 47) took 1113 ms. Trace:
I20260807 13:40:27.171657 23888 tablet_bootstrap.cc:492] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:27.176692 23688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbac6e18ecd14ba2a7d3e846a9fc81bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:27.180176 23692 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47664 (request call id 49) took 1124 ms. Trace:
I20260807 13:40:27.180748 23881 ts_tablet_manager.cc:1428] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.177s user 0.015s sys 0.007s
I20260807 13:40:27.181504 23698 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47664 (request call id 48) took 1125 ms. Trace:
I20260807 13:40:27.181950 23698 rpcz_store.cc:276] 0807 13:40:26.055723 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.944150 (+888427us) service_pool.cc:227] Handling call
0807 13:40:26.953387 (+ 9237us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.953494 (+ 107us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:27.123757 (+170263us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:27.156605 (+ 32848us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:27.181442 (+ 24837us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:27.182493 23881 tablet_bootstrap.cc:492] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:27.184141 23448 catalog_manager.cc:5495] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 1 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:27.171821 23582 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43804 (request call id 52) took 1001 ms. Trace:
I20260807 13:40:27.181169 23692 rpcz_store.cc:276] 0807 13:40:26.056131 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.981487 (+925356us) service_pool.cc:227] Handling call
0807 13:40:26.996235 (+ 14748us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.996467 (+ 232us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:27.145363 (+148896us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:27.179619 (+ 34256us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:27.180109 (+ 490us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:27.175093 23696 rpcz_store.cc:276] 0807 13:40:26.055392 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.934390 (+878998us) service_pool.cc:227] Handling call
0807 13:40:26.984366 (+ 49976us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.984502 (+ 136us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:27.079053 (+ 94551us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:27.126439 (+ 47386us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:27.167508 (+ 41069us) spinlock_profiling.cc:243] Waited 6.96 ms on lock 0x7b5800004598. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914dfee 00007f46220668f9 00007f4620f796a1 00007f462103d20b 00007f4621038e2f 00007f46210395ed 00007f4620fea869 00007f461a5ecc44 00007f461a5ecbd2
0807 13:40:27.168745 (+ 1237us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":16018304}
I20260807 13:40:27.189654 23888 ts_tablet_manager.cc:1397] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.311s user 0.012s sys 0.014s
I20260807 13:40:27.196307 23686 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47664 (request call id 42) took 1387 ms. Trace:
I20260807 13:40:27.196835 23686 rpcz_store.cc:276] 0807 13:40:25.809245 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.843640 (+1034395us) service_pool.cc:227] Handling call
0807 13:40:26.921996 (+ 78356us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.922119 (+ 123us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:27.049991 (+127872us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:27.132171 (+ 82180us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:27.147263 (+ 15092us) spinlock_profiling.cc:243] Waited 6.16 ms on lock 0x7b5800004598. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914de82 00007f46220668b9 00007f4620f795d8 00007f462103d063 00007f4621038e2f 00007f46210395ed 00007f4620fea869 00007f461a5ecc44 00007f461a5ecbd2
0807 13:40:27.196229 (+ 48966us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":14168832}
I20260807 13:40:27.194619 23696 tablet_service.cc:1467] Processing CreateTablet for tablet c9552d42b445450691daef21fba4059a (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260807 13:40:27.208050 23689 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 830e8cb8ce434e6391c09530c677a61d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:27.208621 23686 tablet_service.cc:1467] Processing CreateTablet for tablet e4d6a524bccf4e4a98f503c584d91cb3 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260807 13:40:27.212713 23694 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47664 (request call id 44) took 1325 ms. Trace:
I20260807 13:40:27.213256 23694 rpcz_store.cc:276] 0807 13:40:25.887311 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.855168 (+967857us) service_pool.cc:227] Handling call
0807 13:40:26.921320 (+ 66152us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.921507 (+ 187us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:27.054454 (+132947us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:27.133238 (+ 78784us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:27.169316 (+ 36078us) spinlock_profiling.cc:243] Waited 5.16 ms on lock 0x7b5800004598. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914de82 00007f46220668b9 00007f4620f795d8 00007f462103d063 00007f4621038e2f 00007f46210395ed 00007f4620fea869 00007f461a5ecc44 00007f461a5ecbd2
0807 13:40:27.212627 (+ 43311us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":11865984}
I20260807 13:40:27.210460 23686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4d6a524bccf4e4a98f503c584d91cb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:27.217562 23694 tablet_service.cc:1467] Processing CreateTablet for tablet 1f8a5f186bf1473a988921e5efa3e574 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260807 13:40:27.193202 23695 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47664 (request call id 45) took 1255 ms. Trace:
I20260807 13:40:27.219520 23586 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43804 (request call id 54) took 1048 ms. Trace:
I20260807 13:40:27.219271 23698 tablet_service.cc:1467] Processing CreateTablet for tablet 68ed0b32f1864122a6a9a014c0217c01 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260807 13:40:27.220372 23685 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47664 (request call id 43) took 1351 ms. Trace:
I20260807 13:40:27.224426 23586 rpcz_store.cc:276] 0807 13:40:26.170831 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:27.048238 (+877407us) service_pool.cc:227] Handling call
0807 13:40:27.059004 (+ 10766us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:27.059103 (+ 99us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:27.163803 (+104700us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:27.218803 (+ 55000us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:27.219418 (+ 615us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:27.230327 23696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9552d42b445450691daef21fba4059a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:27.224220 23695 rpcz_store.cc:276] 0807 13:40:25.937518 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.858489 (+920971us) service_pool.cc:227] Handling call
0807 13:40:26.866745 (+ 8256us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.866869 (+ 124us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:27.069630 (+202761us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:27.139160 (+ 69530us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:27.166773 (+ 27613us) spinlock_profiling.cc:243] Waited 6.81 ms on lock 0x7b5800004598. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914de82 00007f46220668b9 00007f4620f795d8 00007f462103d063 00007f4621038e2f 00007f46210395ed 00007f4620fea869 00007f461a5ecc44 00007f461a5ecbd2
0807 13:40:27.192779 (+ 26006us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":15665920}
I20260807 13:40:27.187726 23582 rpcz_store.cc:276] 0807 13:40:26.170098 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:27.031809 (+861711us) service_pool.cc:227] Handling call
0807 13:40:27.038561 (+ 6752us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:27.038700 (+ 139us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:27.155487 (+116787us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:27.171161 (+ 15674us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:27.171758 (+ 597us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:27.231244 23881 tablet_bootstrap.cc:654] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:27.235590 23448 catalog_manager.cc:5495] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 0 to 1, leader changed from <none> to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 1 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:27.238169 23695 tablet_service.cc:1467] Processing CreateTablet for tablet 0f4062e0223a4cc0b2e448e35445671d (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260807 13:40:27.237310 23698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68ed0b32f1864122a6a9a014c0217c01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:27.240258 23884 tablet_bootstrap.cc:492] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:27.240779 23884 ts_tablet_manager.cc:1397] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.225s user 0.012s sys 0.009s
I20260807 13:40:27.243011 23694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f8a5f186bf1473a988921e5efa3e574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:27.246833 23695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f4062e0223a4cc0b2e448e35445671d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:27.246894 23691 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47664 (request call id 50) took 1190 ms. Trace:
I20260807 13:40:27.247381 23691 rpcz_store.cc:276] 0807 13:40:26.056463 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:27.071866 (+1015403us) service_pool.cc:227] Handling call
0807 13:40:27.079845 (+ 7979us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:27.079955 (+ 110us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:27.238778 (+158823us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:27.246331 (+ 7553us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:27.246826 (+ 495us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:27.253551 23884 raft_consensus.cc:348] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.254364 23884 raft_consensus.cc:374] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:27.256422 23884 raft_consensus.cc:729] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:27.257725 23884 consensus_queue.cc:260] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.260633 23884 ts_tablet_manager.cc:1428] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.020s user 0.005s sys 0.003s
I20260807 13:40:27.261629 23884 tablet_bootstrap.cc:492] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:27.215579 23692 tablet_service.cc:1467] Processing CreateTablet for tablet f299697fb7db462dad6c590a8cfea499 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260807 13:40:27.265674 23585 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43804 (request call id 55) took 1094 ms. Trace:
I20260807 13:40:27.266431 23692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f299697fb7db462dad6c590a8cfea499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:27.229640 23888 raft_consensus.cc:348] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
I20260807 13:40:27.269495 23888 raft_consensus.cc:374] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:27.269659 23686 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47664 (request call id 56) took 1031 ms. Trace:
I20260807 13:40:27.269874 23888 raft_consensus.cc:729] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:27.270100 23686 rpcz_store.cc:276] 0807 13:40:26.238112 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:27.198260 (+960148us) service_pool.cc:227] Handling call
0807 13:40:27.209803 (+ 11543us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:27.209944 (+ 141us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:27.258598 (+ 48654us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:27.265946 (+ 7348us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:27.269589 (+ 3643us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:27.266085 23585 rpcz_store.cc:276] 0807 13:40:26.171136 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:27.050514 (+879378us) service_pool.cc:227] Handling call
0807 13:40:27.067406 (+ 16892us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:27.091411 (+ 24005us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:27.170152 (+ 78741us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:27.254784 (+ 84632us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:27.265605 (+ 10821us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:27.270828 23888 consensus_queue.cc:260] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
I20260807 13:40:27.225737 23685 rpcz_store.cc:276] 0807 13:40:25.869104 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.851176 (+982072us) service_pool.cc:227] Handling call
0807 13:40:26.951524 (+100348us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.951632 (+ 108us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:27.108138 (+156506us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:27.219731 (+111593us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:27.220290 (+ 559us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:27.279075 23884 tablet_bootstrap.cc:654] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:27.284060 23692 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47664 (request call id 54) took 1150 ms. Trace:
I20260807 13:40:27.284991 23698 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47664 (request call id 53) took 1155 ms. Trace:
I20260807 13:40:27.284617 23692 rpcz_store.cc:276] 0807 13:40:26.134141 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:27.191170 (+1057029us) service_pool.cc:227] Handling call
0807 13:40:27.265847 (+ 74677us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:27.265941 (+ 94us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:27.275933 (+ 9992us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:27.283551 (+ 7618us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:27.283993 (+ 442us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:27.285529 23698 rpcz_store.cc:276] 0807 13:40:26.129716 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:27.183930 (+1054214us) service_pool.cc:227] Handling call
0807 13:40:27.234963 (+ 51033us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:27.236882 (+ 1919us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:27.269299 (+ 32417us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:27.284457 (+ 15158us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:27.284918 (+ 461us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:27.288765 23888 ts_tablet_manager.cc:1428] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.095s user 0.008s sys 0.000s
I20260807 13:40:27.296566 23888 tablet_bootstrap.cc:492] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:27.296675 23688 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47664 (request call id 52) took 1239 ms. Trace:
I20260807 13:40:27.299062 23688 rpcz_store.cc:276] 0807 13:40:26.057264 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:27.127480 (+1070216us) service_pool.cc:227] Handling call
0807 13:40:27.163802 (+ 36322us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b5800004598. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462105bd21 00007f46210391e3 00007f4620fea869 00007f461a5ecc44 00007f461a5ecbd2 00007f461a5ecb01
0807 13:40:27.176018 (+ 12216us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:27.176256 (+ 238us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:27.260191 (+ 83935us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:27.296102 (+ 35911us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:27.296616 (+ 514us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":51298432}
I20260807 13:40:27.304822 23696 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47664 (request call id 55) took 1136 ms. Trace:
I20260807 13:40:27.305272 23696 rpcz_store.cc:276] 0807 13:40:26.168602 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:27.191292 (+1022690us) service_pool.cc:227] Handling call
0807 13:40:27.218063 (+ 26771us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:27.218174 (+ 111us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:27.247160 (+ 28986us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:27.304275 (+ 57115us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:27.304741 (+ 466us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:27.309322 23689 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47664 (request call id 51) took 1252 ms. Trace:
I20260807 13:40:27.310482 23888 tablet_bootstrap.cc:654] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:27.313984 23881 tablet_bootstrap.cc:492] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:27.314527 23881 ts_tablet_manager.cc:1397] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.132s user 0.011s sys 0.004s
I20260807 13:40:27.316469 23884 tablet_bootstrap.cc:492] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:27.317034 23884 ts_tablet_manager.cc:1397] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.056s user 0.010s sys 0.002s
I20260807 13:40:27.317591 23888 tablet_bootstrap.cc:492] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:27.317381 23881 raft_consensus.cc:348] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.318236 23888 ts_tablet_manager.cc:1397] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.022s user 0.011s sys 0.001s
I20260807 13:40:27.318264 23881 raft_consensus.cc:374] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:27.318915 23881 raft_consensus.cc:729] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:27.319828 23881 consensus_queue.cc:260] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.319880 23884 raft_consensus.cc:348] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.320819 23884 raft_consensus.cc:374] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:27.321135 23884 raft_consensus.cc:729] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:27.309787 23689 rpcz_store.cc:276] 0807 13:40:26.056928 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:27.121170 (+1064242us) service_pool.cc:227] Handling call
0807 13:40:27.152629 (+ 31459us) spinlock_profiling.cc:243] Waited 7.71 ms on lock 0x7b5800004598. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462105bd21 00007f46210391e3 00007f4620fea869 00007f461a5ecc44 00007f461a5ecbd2 00007f461a5ecb01
0807 13:40:27.203487 (+ 50858us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:27.207611 (+ 4124us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:27.230176 (+ 22565us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:27.308789 (+ 78613us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:27.309259 (+ 470us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":17736064}
I20260807 13:40:27.321868 23888 raft_consensus.cc:348] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.321902 23884 consensus_queue.cc:260] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.322952 23888 raft_consensus.cc:374] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:27.324214 23888 raft_consensus.cc:729] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:27.324898 23884 ts_tablet_manager.cc:1428] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260807 13:40:27.325037 23888 consensus_queue.cc:260] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.326006 23884 tablet_bootstrap.cc:492] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:27.326033 23881 ts_tablet_manager.cc:1428] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20260807 13:40:27.330307 23881 tablet_bootstrap.cc:492] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:27.332894 23884 tablet_bootstrap.cc:654] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:27.335683 23888 ts_tablet_manager.cc:1428] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.017s user 0.001s sys 0.006s
I20260807 13:40:27.336704 23881 tablet_bootstrap.cc:654] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:27.346015 23926 raft_consensus.cc:482] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:27.346560 23926 raft_consensus.cc:504] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.347486 23888 tablet_bootstrap.cc:492] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:27.348807 23926 leader_election.cc:288] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:27.350273 23890 raft_consensus.cc:482] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:27.350912 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:27.351234 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:27.350857 23890 raft_consensus.cc:504] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:27.352617 23769 leader_election.cc:341] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:27.356132 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:27.359660 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:27.361294 23890 leader_election.cc:288] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:27.362645 23662 leader_election.cc:341] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:40:27.363562 23660 leader_election.cc:341] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:40:27.353291 23772 leader_election.cc:341] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:27.364413 23660 leader_election.cc:302] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:27.364653 23772 leader_election.cc:302] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:27.366219 23926 raft_consensus.cc:2726] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:27.366210 23890 raft_consensus.cc:2726] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:27.371316 23888 tablet_bootstrap.cc:654] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:27.374996 23884 tablet_bootstrap.cc:492] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:27.375530 23884 ts_tablet_manager.cc:1397] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.050s user 0.021s sys 0.006s
I20260807 13:40:27.377182 23881 tablet_bootstrap.cc:492] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:27.377880 23881 ts_tablet_manager.cc:1397] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.048s user 0.024s sys 0.015s
I20260807 13:40:27.380383 23884 raft_consensus.cc:348] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.381403 23884 raft_consensus.cc:374] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:27.381559 23888 tablet_bootstrap.cc:492] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:27.381853 23884 raft_consensus.cc:729] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:27.382294 23888 ts_tablet_manager.cc:1397] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.035s user 0.007s sys 0.012s
I20260807 13:40:27.381891 23881 raft_consensus.cc:348] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.383065 23881 raft_consensus.cc:374] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:27.383621 23881 raft_consensus.cc:729] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:27.383298 23884 consensus_queue.cc:260] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.384497 23881 consensus_queue.cc:260] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.386988 23884 ts_tablet_manager.cc:1428] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.011s user 0.009s sys 0.003s
I20260807 13:40:27.388150 23881 ts_tablet_manager.cc:1428] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.010s user 0.006s sys 0.003s
I20260807 13:40:27.388918 23884 tablet_bootstrap.cc:492] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:27.390196 23881 tablet_bootstrap.cc:492] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:27.395296 23888 raft_consensus.cc:348] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.396445 23888 raft_consensus.cc:374] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:27.397063 23888 raft_consensus.cc:729] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:27.398092 23888 consensus_queue.cc:260] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.401036 23884 tablet_bootstrap.cc:654] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:27.403087 23881 tablet_bootstrap.cc:654] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:27.415331 23888 ts_tablet_manager.cc:1428] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.033s user 0.002s sys 0.008s
I20260807 13:40:27.416939 23888 tablet_bootstrap.cc:492] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:27.422578 23884 tablet_bootstrap.cc:492] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:27.423324 23884 ts_tablet_manager.cc:1397] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.035s user 0.008s sys 0.018s
I20260807 13:40:27.424935 23881 tablet_bootstrap.cc:492] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:27.425653 23881 ts_tablet_manager.cc:1397] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.036s user 0.012s sys 0.012s
I20260807 13:40:27.427140 23884 raft_consensus.cc:348] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.427992 23884 raft_consensus.cc:374] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:27.428296 23884 raft_consensus.cc:729] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:27.428501 23888 tablet_bootstrap.cc:654] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:27.429034 23884 consensus_queue.cc:260] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.430701 23881 raft_consensus.cc:348] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.431928 23881 raft_consensus.cc:374] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:27.432406 23881 raft_consensus.cc:729] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:27.433665 23881 consensus_queue.cc:260] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.434945 23884 ts_tablet_manager.cc:1428] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.011s user 0.007s sys 0.001s
I20260807 13:40:27.435935 23884 tablet_bootstrap.cc:492] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:27.438006 23881 ts_tablet_manager.cc:1428] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.012s user 0.002s sys 0.007s
I20260807 13:40:27.440202 23881 tablet_bootstrap.cc:492] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:27.444743 23884 tablet_bootstrap.cc:654] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:27.449002 23926 raft_consensus.cc:482] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:27.449973 23926 raft_consensus.cc:504] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.451366 23931 raft_consensus.cc:482] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:27.452143 23931 raft_consensus.cc:504] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.455742 23926 leader_election.cc:288] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:27.463232 23896 raft_consensus.cc:482] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:27.464272 23896 raft_consensus.cc:504] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.467689 23881 tablet_bootstrap.cc:654] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:27.467926 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:27.468858 23711 raft_consensus.cc:2454] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:27.472651 23931 leader_election.cc:288] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:40:27.474947 23660 consensus_peers.cc:487] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 -> Peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Couldn't send request to peer d28e736aee9f4f01b013de670a762697. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:40:27.478068 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:27.479332 23600 raft_consensus.cc:2454] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:27.478405 23890 consensus_queue.cc:1035] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260807 13:40:27.489745 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:27.473587 23926 raft_consensus.cc:482] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:27.491044 23926 raft_consensus.cc:504] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.495229 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:27.485786 23769 leader_election.cc:302] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:27.501129 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:27.503605 23896 leader_election.cc:288] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:27.508422 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:27.497135 23926 leader_election.cc:288] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:27.509435 23598 raft_consensus.cc:2454] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
W20260807 13:40:27.514292 23772 leader_election.cc:341] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:27.514957 23926 raft_consensus.cc:2781] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:27.515426 23926 raft_consensus.cc:482] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:27.515666 23926 raft_consensus.cc:3037] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:40:27.515600 23772 leader_election.cc:341] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:40:27.519976 23769 leader_election.cc:341] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:27.519760 23662 leader_election.cc:302] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:27.520175 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:27.521359 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:27.522567 23769 leader_election.cc:302] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:27.523062 23711 raft_consensus.cc:2454] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:27.523624 23884 tablet_bootstrap.cc:492] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:27.524164 23884 ts_tablet_manager.cc:1397] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.088s user 0.031s sys 0.033s
I20260807 13:40:27.524544 23931 raft_consensus.cc:2726] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:27.526021 23896 raft_consensus.cc:2781] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:27.526633 23896 raft_consensus.cc:482] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:27.527245 23896 raft_consensus.cc:3037] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:27.529104 23881 tablet_bootstrap.cc:492] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:27.533236 23881 ts_tablet_manager.cc:1397] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.093s user 0.017s sys 0.015s
I20260807 13:40:27.533052 23926 raft_consensus.cc:504] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.527107 23769 leader_election.cc:302] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:27.536170 23931 raft_consensus.cc:2781] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:27.536691 23931 raft_consensus.cc:482] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:27.537242 23931 raft_consensus.cc:3037] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:27.539772 23909 raft_consensus.cc:482] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:27.540426 23909 raft_consensus.cc:504] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
I20260807 13:40:27.542768 23881 raft_consensus.cc:348] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.544132 23881 raft_consensus.cc:374] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:27.544667 23881 raft_consensus.cc:729] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:27.545235 23909 leader_election.cc:288] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:27.545966 23881 consensus_queue.cc:260] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.547894 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:27.548326 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:27.548557 23884 raft_consensus.cc:348] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.549412 23884 raft_consensus.cc:374] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:27.549798 23884 raft_consensus.cc:729] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:27.550856 23881 ts_tablet_manager.cc:1428] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.016s user 0.001s sys 0.012s
I20260807 13:40:27.551776 23884 consensus_queue.cc:260] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.552937 23881 tablet_bootstrap.cc:492] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:27.556773 23896 raft_consensus.cc:504] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.559712 23554 leader_election.cc:302] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:27.560289 23896 leader_election.cc:288] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:27.561121 23909 raft_consensus.cc:2726] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:27.562397 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:27.563800 23599 raft_consensus.cc:3037] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:27.567291 23825 raft_consensus.cc:2379] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 1: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:27.562723 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:27.574144 23881 tablet_bootstrap.cc:654] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:27.579732 23896 raft_consensus.cc:482] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:27.580734 23896 raft_consensus.cc:504] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.580843 23931 raft_consensus.cc:504] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.585527 23888 tablet_bootstrap.cc:492] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:27.586282 23888 ts_tablet_manager.cc:1397] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.170s user 0.022s sys 0.040s
I20260807 13:40:27.587821 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:27.588972 23896 leader_election.cc:288] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:27.591528 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:27.592082 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:27.592876 23601 raft_consensus.cc:2379] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 1: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:27.571772 23823 raft_consensus.cc:2379] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 1: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:27.604876 23601 raft_consensus.cc:3037] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:27.594499 23660 leader_election.cc:302] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:27.608008 23896 raft_consensus.cc:3037] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:27.609246 23599 raft_consensus.cc:2454] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:27.611545 23662 leader_election.cc:302] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:27.617894 23926 leader_election.cc:288] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:27.619768 23888 raft_consensus.cc:348] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.620865 23888 raft_consensus.cc:374] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:27.621290 23888 raft_consensus.cc:729] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:27.629676 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:27.631340 23711 raft_consensus.cc:2379] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 1: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:27.630676 23888 consensus_queue.cc:260] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.633710 23884 ts_tablet_manager.cc:1428] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.109s user 0.020s sys 0.039s
I20260807 13:40:27.633587 23769 leader_election.cc:302] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:27.635162 23926 raft_consensus.cc:2726] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:40:27.635665 23888 ts_tablet_manager.cc:1428] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.049s user 0.009s sys 0.001s
I20260807 13:40:27.636242 23881 tablet_bootstrap.cc:492] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:27.636900 23881 ts_tablet_manager.cc:1397] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.084s user 0.017s sys 0.037s
I20260807 13:40:27.637050 23888 tablet_bootstrap.cc:492] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:27.641901 23958 raft_consensus.cc:2781] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:27.642037 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:27.657986 23881 raft_consensus.cc:348] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.648056 23896 raft_consensus.cc:2726] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:27.639552 23884 tablet_bootstrap.cc:492] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:27.658888 23881 raft_consensus.cc:374] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:27.659495 23881 raft_consensus.cc:729] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:27.638633 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:27.660516 23881 consensus_queue.cc:260] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.639417 23931 leader_election.cc:288] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:40:27.663524 23772 leader_election.cc:341] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:27.671356 23881 ts_tablet_manager.cc:1428] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.034s user 0.009s sys 0.003s
I20260807 13:40:27.672374 23881 tablet_bootstrap.cc:492] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:27.669112 23711 raft_consensus.cc:3037] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:27.678787 23888 tablet_bootstrap.cc:654] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:27.682631 23881 tablet_bootstrap.cc:654] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:27.695562 23909 raft_consensus.cc:482] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:27.696219 23909 raft_consensus.cc:504] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.698638 23909 leader_election.cc:288] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:27.700971 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:27.703308 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:27.706415 23555 leader_election.cc:341] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:40:27.707676 23554 leader_election.cc:341] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:27.709842 23554 leader_election.cc:302] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:27.712625 23881 tablet_bootstrap.cc:492] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:27.713167 23881 ts_tablet_manager.cc:1397] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.041s user 0.010s sys 0.004s
I20260807 13:40:27.706813 23958 raft_consensus.cc:686] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:27.717533 23931 consensus_queue.cc:1035] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:40:27.717370 23958 consensus_queue.cc:237] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.719739 23967 raft_consensus.cc:482] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:27.720415 23909 raft_consensus.cc:2726] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:27.720350 23967 raft_consensus.cc:504] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.725912 23884 tablet_bootstrap.cc:654] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:27.734836 23967 leader_election.cc:288] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:27.737654 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:27.738557 23823 raft_consensus.cc:2454] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:27.749672 23660 leader_election.cc:302] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:27.766062 23931 consensus_queue.cc:1035] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260807 13:40:27.754312 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:27.777176 23601 raft_consensus.cc:2454] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:27.758978 23967 raft_consensus.cc:2781] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:27.778537 23967 raft_consensus.cc:482] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:27.780098 23967 raft_consensus.cc:3037] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:27.785604 23711 raft_consensus.cc:2454] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:27.794190 23931 raft_consensus.cc:482] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:27.786165 23449 catalog_manager.cc:5495] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 1 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:27.794874 23931 raft_consensus.cc:504] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.803823 23931 leader_election.cc:288] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:27.805824 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:27.806831 23599 raft_consensus.cc:2454] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:27.808450 23772 leader_election.cc:302] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:27.811384 23931 raft_consensus.cc:2781] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:27.811909 23931 raft_consensus.cc:482] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:27.812350 23931 raft_consensus.cc:3037] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:27.805042 23769 leader_election.cc:302] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:27.835528 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:27.835280 23967 raft_consensus.cc:504] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.836711 23881 raft_consensus.cc:348] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.838160 23881 raft_consensus.cc:374] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:27.838346 23881 raft_consensus.cc:729] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:27.824311 23926 raft_consensus.cc:2781] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:27.838972 23881 consensus_queue.cc:260] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.844281 23881 ts_tablet_manager.cc:1428] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.131s user 0.010s sys 0.001s
I20260807 13:40:27.844580 23889 raft_consensus.cc:482] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:27.845252 23881 tablet_bootstrap.cc:492] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:27.845113 23889 raft_consensus.cc:504] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.840375 23711 raft_consensus.cc:2454] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:27.848816 23967 leader_election.cc:288] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:27.849948 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:27.850730 23599 raft_consensus.cc:3037] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:27.852623 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:27.866370 23889 leader_election.cc:288] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:40:27.880321 23772 leader_election.cc:341] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:27.853713 23931 raft_consensus.cc:504] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:27.874007 23535 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:40:27.884109 23931 leader_election.cc:288] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:27.868286 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:27.866305 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:27.877410 23884 tablet_bootstrap.cc:492] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:27.871589 23881 tablet_bootstrap.cc:654] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:27.886425 23884 ts_tablet_manager.cc:1397] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.247s user 0.041s sys 0.046s
I20260807 13:40:27.891242 23823 raft_consensus.cc:3037] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:27.871932 23599 raft_consensus.cc:2454] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:27.881996 23926 raft_consensus.cc:686] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:27.892760 23926 consensus_queue.cc:237] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.893210 23662 leader_election.cc:302] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:27.894495 23967 raft_consensus.cc:2781] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:27.895291 23967 raft_consensus.cc:686] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:27.896615 23967 consensus_queue.cc:237] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.877557 23888 tablet_bootstrap.cc:492] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:27.890035 23884 raft_consensus.cc:348] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.885243 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:27.901901 23884 raft_consensus.cc:374] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:27.902155 23601 raft_consensus.cc:3037] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:27.905004 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:27.902238 23884 raft_consensus.cc:729] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:27.902827 23888 ts_tablet_manager.cc:1397] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.266s user 0.040s sys 0.004s
I20260807 13:40:27.907143 23711 raft_consensus.cc:3037] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:27.906821 23884 consensus_queue.cc:260] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.912029 23884 ts_tablet_manager.cc:1428] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.025s user 0.007s sys 0.000s
W20260807 13:40:27.913199 23769 leader_election.cc:341] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:27.913784 23769 leader_election.cc:302] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:27.915607 23983 raft_consensus.cc:2726] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:27.919224 23823 raft_consensus.cc:2454] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:27.913174 23884 tablet_bootstrap.cc:492] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:27.929646 23888 raft_consensus.cc:348] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.930900 23888 raft_consensus.cc:374] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:27.931399 23888 raft_consensus.cc:729] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:27.935232 23881 tablet_bootstrap.cc:492] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:27.941010 23881 ts_tablet_manager.cc:1397] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.096s user 0.021s sys 0.008s
I20260807 13:40:27.941380 23888 consensus_queue.cc:260] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.943881 23888 ts_tablet_manager.cc:1428] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.035s user 0.006s sys 0.001s
I20260807 13:40:27.943734 23881 raft_consensus.cc:348] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.944556 23881 raft_consensus.cc:374] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:27.944921 23881 raft_consensus.cc:729] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:27.946353 23881 consensus_queue.cc:260] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.948946 23888 tablet_bootstrap.cc:492] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:27.939273 23711 raft_consensus.cc:2454] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:27.935972 23884 tablet_bootstrap.cc:654] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:27.949013 23881 ts_tablet_manager.cc:1428] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260807 13:40:27.950876 23881 tablet_bootstrap.cc:492] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:27.950642 23769 leader_election.cc:302] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:27.951879 23889 raft_consensus.cc:2781] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:27.952471 23889 raft_consensus.cc:686] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:27.953644 23889 consensus_queue.cc:237] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.957756 23447 catalog_manager.cc:5495] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 0 to 1, leader changed from <none> to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 1 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:27.971094 23881 tablet_bootstrap.cc:654] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:27.978518 23601 raft_consensus.cc:2454] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:27.984180 23931 raft_consensus.cc:482] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:27.984838 23931 raft_consensus.cc:504] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:27.989037 23888 tablet_bootstrap.cc:654] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:27.994343 23884 tablet_bootstrap.cc:492] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:27.994975 23884 ts_tablet_manager.cc:1397] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.082s user 0.011s sys 0.016s
I20260807 13:40:27.999711 23967 raft_consensus.cc:482] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:28.000408 23967 raft_consensus.cc:504] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.004765 23967 leader_election.cc:288] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:28.002306 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:28.006098 23601 raft_consensus.cc:2454] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:28.006484 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:28.007575 23931 leader_election.cc:288] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:28.011179 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:28.011327 23884 raft_consensus.cc:348] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.012225 23884 raft_consensus.cc:374] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:28.012220 23711 raft_consensus.cc:2454] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:28.012666 23884 raft_consensus.cc:729] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:28.013419 23884 consensus_queue.cc:260] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.010375 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:28.016021 23823 raft_consensus.cc:2454] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:28.016564 23884 ts_tablet_manager.cc:1428] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.021s user 0.009s sys 0.000s
I20260807 13:40:28.017881 23884 tablet_bootstrap.cc:492] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:28.018286 23660 leader_election.cc:302] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
W20260807 13:40:28.021561 23662 leader_election.cc:341] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:28.028995 23884 tablet_bootstrap.cc:654] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:28.017910 23769 leader_election.cc:302] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:28.032215 23931 raft_consensus.cc:2781] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:28.032881 23931 raft_consensus.cc:482] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:28.033573 23931 raft_consensus.cc:3037] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:28.036008 23967 raft_consensus.cc:2781] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:28.036561 23967 raft_consensus.cc:482] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:28.037175 23967 raft_consensus.cc:3037] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:28.045099 23884 tablet_bootstrap.cc:492] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:28.045746 23884 ts_tablet_manager.cc:1397] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.028s user 0.021s sys 0.003s
I20260807 13:40:28.050025 23884 raft_consensus.cc:348] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.051079 23884 raft_consensus.cc:374] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:28.051350 23884 raft_consensus.cc:729] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:28.052311 23884 consensus_queue.cc:260] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.055576 23884 ts_tablet_manager.cc:1428] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.009s user 0.006s sys 0.005s
I20260807 13:40:28.056735 23884 tablet_bootstrap.cc:492] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:28.060499 23448 catalog_manager.cc:5495] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 1 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:28.065692 23884 tablet_bootstrap.cc:654] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:28.073693 23931 raft_consensus.cc:504] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.077658 23967 raft_consensus.cc:504] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.085760 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
W20260807 13:40:28.087847 23662 leader_election.cc:341] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:28.088025 23967 leader_election.cc:288] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:28.089696 23931 leader_election.cc:288] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:28.089601 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:28.089777 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:28.089603 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:28.090525 23711 raft_consensus.cc:3037] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:28.091792 23598 raft_consensus.cc:3037] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:28.091831 23823 raft_consensus.cc:3037] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:28.113827 23823 raft_consensus.cc:2454] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:28.118192 23884 tablet_bootstrap.cc:492] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:28.118832 23884 ts_tablet_manager.cc:1397] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.062s user 0.027s sys 0.014s
I20260807 13:40:28.118955 23598 raft_consensus.cc:2454] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:28.119047 23660 leader_election.cc:302] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:28.120554 23772 leader_election.cc:302] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:28.121567 23970 raft_consensus.cc:2781] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:28.121615 23931 raft_consensus.cc:2781] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:28.122133 23884 raft_consensus.cc:348] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.122494 23931 raft_consensus.cc:686] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:28.122947 23884 raft_consensus.cc:374] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:28.123215 23884 raft_consensus.cc:729] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:28.122287 23970 raft_consensus.cc:686] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:28.124008 23711 raft_consensus.cc:2454] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:28.123636 23931 consensus_queue.cc:237] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.124495 23884 consensus_queue.cc:260] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.124718 23970 consensus_queue.cc:237] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.126937 23884 ts_tablet_manager.cc:1428] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260807 13:40:28.128079 23884 tablet_bootstrap.cc:492] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:28.132711 23888 tablet_bootstrap.cc:492] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:28.133198 23888 ts_tablet_manager.cc:1397] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.184s user 0.046s sys 0.046s
I20260807 13:40:28.138578 23888 raft_consensus.cc:348] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.139380 23888 raft_consensus.cc:374] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:28.138193 23447 catalog_manager.cc:5495] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 0 to 1, leader changed from <none> to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 1 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:28.139680 23888 raft_consensus.cc:729] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:28.140226 23884 tablet_bootstrap.cc:654] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:28.142238 23881 tablet_bootstrap.cc:492] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:28.142956 23888 consensus_queue.cc:260] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.143934 23881 ts_tablet_manager.cc:1397] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.193s user 0.027s sys 0.041s
I20260807 13:40:28.154842 23888 ts_tablet_manager.cc:1428] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.021s user 0.009s sys 0.000s
I20260807 13:40:28.156038 23888 tablet_bootstrap.cc:492] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:28.158460 23881 raft_consensus.cc:348] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.159381 23881 raft_consensus.cc:374] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:28.159693 23881 raft_consensus.cc:729] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:28.165483 23881 consensus_queue.cc:260] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.168960 23881 ts_tablet_manager.cc:1428] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.025s user 0.006s sys 0.000s
I20260807 13:40:28.170085 23881 tablet_bootstrap.cc:492] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:28.177455 23888 tablet_bootstrap.cc:654] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:28.177824 23881 tablet_bootstrap.cc:654] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:28.194945 23967 raft_consensus.cc:482] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:28.195923 23967 raft_consensus.cc:504] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.198891 23970 raft_consensus.cc:482] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:28.199452 23970 raft_consensus.cc:504] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.201809 23970 leader_election.cc:288] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:28.201608 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:28.204638 23662 leader_election.cc:341] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:28.205274 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:28.206704 23931 raft_consensus.cc:482] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:28.207249 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:28.207371 23931 raft_consensus.cc:504] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.208004 23823 raft_consensus.cc:2454] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:28.208069 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:28.209342 23662 leader_election.cc:341] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:28.210359 23884 tablet_bootstrap.cc:492] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:28.210028 23660 leader_election.cc:302] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:28.211030 23884 ts_tablet_manager.cc:1397] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.083s user 0.005s sys 0.015s
I20260807 13:40:28.211023 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:28.204183 23967 leader_election.cc:288] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:28.217478 23884 raft_consensus.cc:348] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.218468 23884 raft_consensus.cc:374] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260807 13:40:28.211731 23660 leader_election.cc:341] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:28.218871 23884 raft_consensus.cc:729] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:28.220060 23660 leader_election.cc:302] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:28.221001 23890 raft_consensus.cc:2726] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 13:40:28.221136 23772 leader_election.cc:341] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:28.213279 23970 raft_consensus.cc:2781] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:28.222487 23931 leader_election.cc:288] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:28.222836 23970 raft_consensus.cc:482] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:28.223474 23970 raft_consensus.cc:3037] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:28.224104 23884 consensus_queue.cc:260] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.231757 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:28.232589 23711 raft_consensus.cc:2454] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:28.234967 23769 leader_election.cc:302] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:28.236157 23931 raft_consensus.cc:2781] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:28.236578 23931 raft_consensus.cc:482] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:28.237100 23931 raft_consensus.cc:3037] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:28.237192 23447 catalog_manager.cc:5495] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 1 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:28.239315 23890 consensus_queue.cc:1035] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:28.229378 23450 catalog_manager.cc:5495] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 0 to 1, leader changed from <none> to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 1 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:28.248951 23884 ts_tablet_manager.cc:1428] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.037s user 0.006s sys 0.003s
I20260807 13:40:28.250023 23884 tablet_bootstrap.cc:492] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:28.250928 23888 tablet_bootstrap.cc:492] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:28.251353 23888 ts_tablet_manager.cc:1397] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.096s user 0.032s sys 0.032s
I20260807 13:40:28.254537 23888 raft_consensus.cc:348] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.258785 23888 raft_consensus.cc:374] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:28.259088 23888 raft_consensus.cc:729] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:28.260099 23888 consensus_queue.cc:260] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.262537 23888 ts_tablet_manager.cc:1428] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.011s user 0.002s sys 0.005s
I20260807 13:40:28.263437 23884 tablet_bootstrap.cc:654] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:28.263484 23888 tablet_bootstrap.cc:492] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:28.265784 23881 tablet_bootstrap.cc:492] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:28.266259 23881 ts_tablet_manager.cc:1397] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.096s user 0.007s sys 0.007s
I20260807 13:40:28.277113 23888 tablet_bootstrap.cc:654] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:28.279851 23890 consensus_queue.cc:1035] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:28.279342 23970 raft_consensus.cc:504] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.284075 23970 leader_election.cc:288] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:28.286218 23881 raft_consensus.cc:348] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.286983 23881 raft_consensus.cc:374] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:28.287230 23881 raft_consensus.cc:729] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:28.287847 23881 consensus_queue.cc:260] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.289186 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:28.289934 23823 raft_consensus.cc:3037] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:28.294121 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
W20260807 13:40:28.297297 23662 leader_election.cc:341] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:28.298832 23931 raft_consensus.cc:504] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.289976 23881 ts_tablet_manager.cc:1428] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.023s user 0.009s sys 0.000s
I20260807 13:40:28.301060 23881 tablet_bootstrap.cc:492] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:28.302883 23823 raft_consensus.cc:2454] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:28.305755 23931 leader_election.cc:288] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:28.307466 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:28.308259 23711 raft_consensus.cc:3037] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:28.314530 23909 raft_consensus.cc:482] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:28.315483 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:28.315898 23909 raft_consensus.cc:504] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.317216 23881 tablet_bootstrap.cc:654] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:28.317811 23660 leader_election.cc:302] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:28.316491 23598 raft_consensus.cc:3037] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:28.320119 23970 raft_consensus.cc:2781] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:28.320948 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:28.325356 23970 raft_consensus.cc:686] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:28.326985 23970 consensus_queue.cc:237] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.328668 23710 raft_consensus.cc:2379] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 1: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:28.332445 23889 raft_consensus.cc:482] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:28.333204 23889 raft_consensus.cc:504] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.323313 23909 leader_election.cc:288] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:28.336678 23889 leader_election.cc:288] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:28.336899 23926 raft_consensus.cc:482] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:28.337468 23926 raft_consensus.cc:504] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.338809 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:28.341176 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:28.341964 23601 raft_consensus.cc:2454] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:28.352813 23711 raft_consensus.cc:2454] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:28.355839 23554 leader_election.cc:302] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:28.356756 23884 tablet_bootstrap.cc:492] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:28.357383 23884 ts_tablet_manager.cc:1397] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.108s user 0.015s sys 0.012s
I20260807 13:40:28.357722 23909 raft_consensus.cc:3037] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:28.359751 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:28.360240 23888 tablet_bootstrap.cc:492] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:28.362591 23884 raft_consensus.cc:348] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.365340 23888 ts_tablet_manager.cc:1397] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.102s user 0.009s sys 0.022s
I20260807 13:40:28.365358 23884 raft_consensus.cc:374] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:28.365373 23711 raft_consensus.cc:2454] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:28.366017 23884 raft_consensus.cc:729] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:28.367115 23926 leader_election.cc:288] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:28.367028 23884 consensus_queue.cc:260] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.369359 23884 ts_tablet_manager.cc:1428] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.011s user 0.005s sys 0.002s
I20260807 13:40:28.369202 23888 raft_consensus.cc:348] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.369943 23888 raft_consensus.cc:374] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:28.370201 23888 raft_consensus.cc:729] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:28.370416 23884 tablet_bootstrap.cc:492] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:28.371531 23772 leader_election.cc:302] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:28.373580 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:28.363845 23769 leader_election.cc:302] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:28.375385 23931 raft_consensus.cc:2781] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:28.375864 23931 raft_consensus.cc:482] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:28.376235 23931 raft_consensus.cc:3037] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:40:28.376299 23772 leader_election.cc:341] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:28.377210 23888 consensus_queue.cc:260] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.378546 23889 raft_consensus.cc:2781] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:28.379101 23889 raft_consensus.cc:686] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:28.380155 23889 consensus_queue.cc:237] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.383068 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:28.385623 23881 tablet_bootstrap.cc:492] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:28.386243 23881 ts_tablet_manager.cc:1397] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.085s user 0.004s sys 0.016s
I20260807 13:40:28.390067 23909 raft_consensus.cc:2726] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:28.390417 23931 raft_consensus.cc:504] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.404091 23970 consensus_queue.cc:1035] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260807 13:40:28.411458 23769 leader_election.cc:341] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:28.412077 23769 leader_election.cc:302] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:28.413133 23983 raft_consensus.cc:2726] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:28.406302 23881 raft_consensus.cc:348] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.414131 23881 raft_consensus.cc:374] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:28.414454 23881 raft_consensus.cc:729] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:28.415253 23881 consensus_queue.cc:260] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.417068 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:28.418068 23601 raft_consensus.cc:3037] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:28.418630 23931 leader_election.cc:288] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:28.411062 23884 tablet_bootstrap.cc:654] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:28.409386 23447 catalog_manager.cc:5495] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 1 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:28.417490 23881 ts_tablet_manager.cc:1428] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.031s user 0.008s sys 0.000s
I20260807 13:40:28.425269 23881 tablet_bootstrap.cc:492] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:28.433681 23881 tablet_bootstrap.cc:654] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:28.439507 23931 consensus_queue.cc:1035] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:28.445132 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:28.449323 23711 raft_consensus.cc:3037] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:28.452541 23598 raft_consensus.cc:2454] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:28.453594 23931 consensus_queue.cc:1035] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:28.491631 23970 raft_consensus.cc:482] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:28.493041 23970 raft_consensus.cc:504] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.494155 23983 consensus_queue.cc:1035] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:28.497504 23970 leader_election.cc:288] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:28.499300 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:28.501430 23660 leader_election.cc:341] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:28.508996 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:28.543359 23601 raft_consensus.cc:2454] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:28.547065 23772 leader_election.cc:302] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:28.548270 23931 raft_consensus.cc:2781] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:28.549018 23931 raft_consensus.cc:686] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:28.550809 23970 consensus_queue.cc:1035] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260807 13:40:28.549052 24022 log.cc:924] Time spent T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.060s user 0.001s sys 0.000s
I20260807 13:40:28.563812 23825 raft_consensus.cc:3037] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:28.550375 23931 consensus_queue.cc:237] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.626986 23888 ts_tablet_manager.cc:1428] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.261s user 0.037s sys 0.071s
I20260807 13:40:28.629519 23888 tablet_bootstrap.cc:492] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
W20260807 13:40:28.631146 23662 leader_election.cc:341] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:28.635169 23662 leader_election.cc:302] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:28.637560 23967 raft_consensus.cc:2726] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:28.623165 23711 raft_consensus.cc:2454] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:28.633379 23958 consensus_queue.cc:1035] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:28.634263 23450 catalog_manager.cc:5495] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 0 to 1, leader changed from <none> to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 1 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:28.671955 23881 tablet_bootstrap.cc:492] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:28.672482 23881 ts_tablet_manager.cc:1397] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.247s user 0.012s sys 0.042s
I20260807 13:40:28.679734 23881 raft_consensus.cc:348] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.654593 23889 consensus_queue.cc:1035] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260807 13:40:28.680478 23881 raft_consensus.cc:374] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:28.680779 23881 raft_consensus.cc:729] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:28.681465 23881 consensus_queue.cc:260] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.684561 23884 tablet_bootstrap.cc:492] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:28.685022 23884 ts_tablet_manager.cc:1397] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.315s user 0.016s sys 0.045s
I20260807 13:40:28.701596 23884 raft_consensus.cc:348] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.702278 23884 raft_consensus.cc:374] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:28.702533 23884 raft_consensus.cc:729] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:28.703327 23884 consensus_queue.cc:260] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.705390 23884 ts_tablet_manager.cc:1428] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.020s user 0.005s sys 0.001s
I20260807 13:40:28.706339 23884 tablet_bootstrap.cc:492] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:28.718961 23881 ts_tablet_manager.cc:1428] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.046s user 0.010s sys 0.022s
I20260807 13:40:28.720655 23881 tablet_bootstrap.cc:492] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:28.739630 23958 consensus_queue.cc:1035] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:28.754499 23931 consensus_queue.cc:1035] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:28.756775 24032 consensus_queue.cc:1035] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:28.757287 23884 tablet_bootstrap.cc:654] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
W20260807 13:40:28.776309 23662 consensus_peers.cc:487] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 -> Peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Couldn't send request to peer 08757cfbeffb41bbab14c2ef00e9d812. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:40:28.783875 23983 raft_consensus.cc:482] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:28.784922 23983 raft_consensus.cc:504] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.790148 23881 tablet_bootstrap.cc:654] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
W20260807 13:40:28.799973 23662 consensus_peers.cc:487] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 -> Peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Couldn't send request to peer 08757cfbeffb41bbab14c2ef00e9d812. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:40:28.807853 23983 leader_election.cc:288] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:28.809432 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:28.811133 23888 tablet_bootstrap.cc:654] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:28.809948 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:28.817036 24014 raft_consensus.cc:482] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:28.816972 23772 leader_election.cc:302] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:28.817715 24014 raft_consensus.cc:504] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.821682 24032 raft_consensus.cc:2726] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:28.822029 23983 consensus_queue.cc:1035] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:28.825268 23967 raft_consensus.cc:482] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:28.825882 23967 raft_consensus.cc:504] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.831087 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:28.831988 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:28.834774 23555 leader_election.cc:341] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:28.834699 23450 catalog_manager.cc:5495] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 0 to 1, leader changed from <none> to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 1 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:28.835682 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:28.835969 23662 leader_election.cc:341] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:40:28.837558 23554 leader_election.cc:341] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:28.838109 23967 leader_election.cc:288] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:28.838347 23554 leader_election.cc:302] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:28.832007 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:28.834084 24014 leader_election.cc:288] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:28.839720 23909 raft_consensus.cc:2726] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 13:40:28.841239 23660 leader_election.cc:341] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:28.841874 23660 leader_election.cc:302] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:28.844522 23967 raft_consensus.cc:2726] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:28.906530 23888 tablet_bootstrap.cc:492] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:28.907240 23888 ts_tablet_manager.cc:1397] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.278s user 0.021s sys 0.007s
I20260807 13:40:28.911340 23888 raft_consensus.cc:348] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.912377 23888 raft_consensus.cc:374] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:28.912731 23888 raft_consensus.cc:729] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:28.916049 23881 tablet_bootstrap.cc:492] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:28.916530 23881 ts_tablet_manager.cc:1397] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.196s user 0.015s sys 0.011s
I20260807 13:40:28.919601 23881 raft_consensus.cc:348] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.920310 23881 raft_consensus.cc:374] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:28.920579 23881 raft_consensus.cc:729] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:28.921190 23881 consensus_queue.cc:260] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.922250 23888 consensus_queue.cc:260] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.925231 23888 ts_tablet_manager.cc:1428] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.018s user 0.008s sys 0.000s
I20260807 13:40:28.926162 23888 tablet_bootstrap.cc:492] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:28.936089 23881 ts_tablet_manager.cc:1428] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.019s user 0.003s sys 0.005s
I20260807 13:40:28.939515 23881 tablet_bootstrap.cc:492] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:28.940428 23931 consensus_queue.cc:1035] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:28.956008 23884 tablet_bootstrap.cc:492] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:28.957968 23884 ts_tablet_manager.cc:1397] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.252s user 0.019s sys 0.011s
W20260807 13:40:28.962108 23535 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:40:28.966528 23881 tablet_bootstrap.cc:654] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:28.971580 23888 tablet_bootstrap.cc:654] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:28.975912 23884 raft_consensus.cc:348] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.976444 23884 raft_consensus.cc:374] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:28.976701 23884 raft_consensus.cc:729] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:28.977270 23884 consensus_queue.cc:260] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:28.988242 23884 ts_tablet_manager.cc:1428] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.030s user 0.003s sys 0.003s
I20260807 13:40:28.992012 23881 tablet_bootstrap.cc:492] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:28.992616 23881 ts_tablet_manager.cc:1397] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.053s user 0.005s sys 0.009s
I20260807 13:40:28.999303 23884 tablet_bootstrap.cc:492] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:29.000288 24014 raft_consensus.cc:482] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:29.000965 24014 raft_consensus.cc:504] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.003409 24014 leader_election.cc:288] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:29.004619 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:29.005643 23710 raft_consensus.cc:2454] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 0.
I20260807 13:40:29.006832 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:29.007431 23555 leader_election.cc:302] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:29.008657 24014 raft_consensus.cc:2781] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260807 13:40:29.009948 23554 leader_election.cc:341] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:28.997522 23958 raft_consensus.cc:482] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:29.011571 23958 raft_consensus.cc:504] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.015954 23958 leader_election.cc:288] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:29.009253 24014 raft_consensus.cc:482] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:29.016294 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:29.017123 24014 raft_consensus.cc:3037] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:29.018255 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:29.019044 23662 leader_election.cc:341] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:40:29.020260 23660 leader_election.cc:341] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:29.020974 23660 leader_election.cc:302] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:29.022387 23958 raft_consensus.cc:2726] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:29.030193 23881 raft_consensus.cc:348] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.036049 23881 raft_consensus.cc:374] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:29.036331 23884 tablet_bootstrap.cc:654] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:29.036490 23881 raft_consensus.cc:729] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:29.037372 23931 raft_consensus.cc:482] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:29.038120 23931 raft_consensus.cc:504] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.041642 23931 leader_election.cc:288] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:29.042611 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:29.044654 23772 leader_election.cc:341] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:29.042842 23881 consensus_queue.cc:260] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.047113 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:29.049178 23769 leader_election.cc:341] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:29.049846 23769 leader_election.cc:302] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:29.050498 23881 ts_tablet_manager.cc:1428] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.058s user 0.009s sys 0.000s
I20260807 13:40:29.048233 24014 raft_consensus.cc:504] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.051555 23931 raft_consensus.cc:2726] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:29.053997 23881 tablet_bootstrap.cc:492] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:29.054216 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:29.054874 23710 raft_consensus.cc:3037] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:29.056026 24014 leader_election.cc:288] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:29.059864 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:29.060525 23884 tablet_bootstrap.cc:492] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:29.061146 23884 ts_tablet_manager.cc:1397] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.062s user 0.016s sys 0.010s
W20260807 13:40:29.061942 23554 leader_election.cc:341] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:29.062764 23888 tablet_bootstrap.cc:492] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:29.063293 23888 ts_tablet_manager.cc:1397] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.137s user 0.018s sys 0.018s
I20260807 13:40:29.067413 23888 raft_consensus.cc:348] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.068205 23888 raft_consensus.cc:374] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:29.068528 23888 raft_consensus.cc:729] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:29.069232 23888 consensus_queue.cc:260] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.074550 23884 raft_consensus.cc:348] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.075482 23884 raft_consensus.cc:374] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:29.075781 23884 raft_consensus.cc:729] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:29.076435 23888 ts_tablet_manager.cc:1428] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.012s user 0.006s sys 0.001s
I20260807 13:40:29.076586 23884 consensus_queue.cc:260] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.077528 23888 tablet_bootstrap.cc:492] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:29.088198 23888 tablet_bootstrap.cc:654] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:29.087798 23710 raft_consensus.cc:2454] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:29.090242 23555 leader_election.cc:302] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:29.091739 24014 raft_consensus.cc:2781] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:29.092260 24014 raft_consensus.cc:686] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:29.093459 24014 consensus_queue.cc:237] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.095062 23884 ts_tablet_manager.cc:1428] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.034s user 0.005s sys 0.012s
I20260807 13:40:29.098428 23958 raft_consensus.cc:482] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:29.099002 23958 raft_consensus.cc:504] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.103322 23931 raft_consensus.cc:482] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:29.103914 23931 raft_consensus.cc:504] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.105412 23884 tablet_bootstrap.cc:492] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:29.107297 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:29.108150 23820 raft_consensus.cc:2454] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:29.111699 23660 leader_election.cc:302] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:29.113257 23890 raft_consensus.cc:2781] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:29.113858 23890 raft_consensus.cc:482] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:29.092303 23881 tablet_bootstrap.cc:654] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:29.114281 23890 raft_consensus.cc:3037] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:29.116782 23884 tablet_bootstrap.cc:654] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:29.106496 23931 leader_election.cc:288] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:29.118563 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:29.119486 23711 raft_consensus.cc:2454] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:29.120086 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:29.120808 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:29.122824 23769 leader_election.cc:302] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:29.121904 23958 leader_election.cc:288] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:29.124609 23662 leader_election.cc:341] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:40:29.125685 23772 leader_election.cc:341] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:29.127061 23931 raft_consensus.cc:2781] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:29.127780 23931 raft_consensus.cc:482] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:29.132673 23931 raft_consensus.cc:3037] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:29.141427 23909 raft_consensus.cc:482] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:29.142330 23909 raft_consensus.cc:504] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.144785 23890 raft_consensus.cc:504] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.147836 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:29.150584 23555 leader_election.cc:341] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:29.152262 23909 leader_election.cc:288] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:29.153986 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:29.155130 23820 raft_consensus.cc:2454] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 0.
I20260807 13:40:29.159468 23888 tablet_bootstrap.cc:492] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:29.160068 23888 ts_tablet_manager.cc:1397] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.083s user 0.020s sys 0.040s
I20260807 13:40:29.162282 23554 leader_election.cc:302] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:29.163465 23881 tablet_bootstrap.cc:492] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:29.163897 23881 ts_tablet_manager.cc:1397] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.110s user 0.008s sys 0.018s
I20260807 13:40:29.166823 24014 raft_consensus.cc:2781] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:29.167459 24014 raft_consensus.cc:482] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:29.168087 24014 raft_consensus.cc:3037] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:29.167615 23448 catalog_manager.cc:5495] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 0 to 1, leader changed from <none> to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 1 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:29.171355 23881 raft_consensus.cc:348] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.172325 23881 raft_consensus.cc:374] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:29.172667 23881 raft_consensus.cc:729] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:29.175333 23888 raft_consensus.cc:348] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.176198 23888 raft_consensus.cc:374] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:29.176498 23888 raft_consensus.cc:729] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:29.177184 23888 consensus_queue.cc:260] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.179899 23888 ts_tablet_manager.cc:1428] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.019s user 0.005s sys 0.003s
I20260807 13:40:29.183362 23888 tablet_bootstrap.cc:492] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:29.173511 23881 consensus_queue.cc:260] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.185354 23881 ts_tablet_manager.cc:1428] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.021s user 0.005s sys 0.002s
I20260807 13:40:29.186300 23881 tablet_bootstrap.cc:492] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:29.187100 24014 raft_consensus.cc:504] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.188005 23884 tablet_bootstrap.cc:492] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:29.188654 23884 ts_tablet_manager.cc:1397] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.083s user 0.032s sys 0.016s
I20260807 13:40:29.190336 24014 leader_election.cc:288] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:29.191865 23983 consensus_queue.cc:1035] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:29.192708 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
W20260807 13:40:29.194150 23555 leader_election.cc:341] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:29.196498 23884 raft_consensus.cc:348] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.196633 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:29.197324 23884 raft_consensus.cc:374] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:29.197463 23820 raft_consensus.cc:3037] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:29.197716 23884 raft_consensus.cc:729] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:29.198568 23884 consensus_queue.cc:260] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.201225 23884 ts_tablet_manager.cc:1428] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.012s user 0.007s sys 0.000s
I20260807 13:40:29.201179 23983 consensus_queue.cc:1035] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:29.202517 23884 tablet_bootstrap.cc:492] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:29.205307 23890 leader_election.cc:288] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:29.182309 23931 raft_consensus.cc:504] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.201718 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:29.212337 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:29.221271 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
W20260807 13:40:29.221834 23662 leader_election.cc:341] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:40:29.222977 23772 leader_election.cc:341] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:29.224241 23931 leader_election.cc:288] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:29.219568 23825 raft_consensus.cc:3037] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:29.226971 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:29.227991 23711 raft_consensus.cc:3037] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:29.240833 23888 tablet_bootstrap.cc:654] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:29.240965 23931 raft_consensus.cc:482] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:29.241499 23601 raft_consensus.cc:3037] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:29.246978 23881 tablet_bootstrap.cc:654] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:29.262761 23825 raft_consensus.cc:2454] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:29.266170 23660 leader_election.cc:302] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:29.267849 23890 raft_consensus.cc:2781] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:29.241820 23931 raft_consensus.cc:504] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.269027 23890 raft_consensus.cc:686] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:29.273145 23890 consensus_queue.cc:237] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.276907 23931 leader_election.cc:288] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:29.279031 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:29.279663 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:29.282471 23884 tablet_bootstrap.cc:654] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:29.280100 23710 raft_consensus.cc:2454] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
W20260807 13:40:29.282883 23772 leader_election.cc:341] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:29.285908 23769 leader_election.cc:302] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:29.298471 23820 raft_consensus.cc:2454] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:29.301785 23881 tablet_bootstrap.cc:492] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:29.302450 23881 ts_tablet_manager.cc:1397] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.116s user 0.005s sys 0.013s
I20260807 13:40:29.296051 23931 raft_consensus.cc:2781] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:29.304469 23931 raft_consensus.cc:482] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:29.305182 23931 raft_consensus.cc:3037] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:29.307893 23554 leader_election.cc:302] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:29.309489 24014 raft_consensus.cc:2781] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:29.310297 24014 raft_consensus.cc:686] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:29.312404 24014 consensus_queue.cc:237] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.316576 23931 raft_consensus.cc:504] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.319641 23931 leader_election.cc:288] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:29.322439 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
W20260807 13:40:29.325682 23772 leader_election.cc:341] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:29.327347 23711 raft_consensus.cc:2454] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:29.333478 23881 raft_consensus.cc:348] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.334403 23881 raft_consensus.cc:374] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:29.337589 23881 raft_consensus.cc:729] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:29.338915 23881 consensus_queue.cc:260] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.342728 23881 ts_tablet_manager.cc:1428] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.040s user 0.008s sys 0.000s
I20260807 13:40:29.343750 23881 tablet_bootstrap.cc:492] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:29.347576 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:29.348383 23710 raft_consensus.cc:3037] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:29.345907 23769 leader_election.cc:302] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:29.352224 23931 raft_consensus.cc:2781] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:29.359869 23931 raft_consensus.cc:686] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:29.361308 23931 consensus_queue.cc:237] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.372545 23888 tablet_bootstrap.cc:492] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:29.373123 23888 ts_tablet_manager.cc:1397] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.190s user 0.004s sys 0.022s
I20260807 13:40:29.373402 23710 raft_consensus.cc:2454] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:29.375650 23769 leader_election.cc:302] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:29.378322 24032 raft_consensus.cc:2781] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:29.379101 24032 raft_consensus.cc:686] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:29.383682 23888 raft_consensus.cc:348] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.384720 23888 raft_consensus.cc:374] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:29.385063 23888 raft_consensus.cc:729] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:29.396639 24032 consensus_queue.cc:237] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.398622 23881 tablet_bootstrap.cc:654] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:29.402398 23888 consensus_queue.cc:260] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.404426 23450 catalog_manager.cc:5495] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 0 to 1, leader changed from <none> to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 1 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:29.413112 23888 ts_tablet_manager.cc:1428] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.040s user 0.007s sys 0.014s
I20260807 13:40:29.414333 23888 tablet_bootstrap.cc:492] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:29.416157 23884 tablet_bootstrap.cc:492] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:29.416646 23884 ts_tablet_manager.cc:1397] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.214s user 0.017s sys 0.015s
I20260807 13:40:29.420671 23884 raft_consensus.cc:348] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.421505 23884 raft_consensus.cc:374] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:29.421775 23884 raft_consensus.cc:729] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:29.424394 24063 raft_consensus.cc:482] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:29.422530 23884 consensus_queue.cc:260] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.429602 23881 tablet_bootstrap.cc:492] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:29.430207 23881 ts_tablet_manager.cc:1397] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.087s user 0.018s sys 0.003s
I20260807 13:40:29.427883 24063 raft_consensus.cc:504] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.440073 24031 raft_consensus.cc:482] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:29.440829 24031 raft_consensus.cc:504] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.441341 24063 leader_election.cc:288] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:29.442535 23884 ts_tablet_manager.cc:1428] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.026s user 0.009s sys 0.000s
I20260807 13:40:29.444746 23884 tablet_bootstrap.cc:492] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:29.446979 24031 leader_election.cc:288] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:29.448333 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:29.448412 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:29.448690 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:29.455392 23449 catalog_manager.cc:5495] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 1 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:29.453709 23601 raft_consensus.cc:2454] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
W20260807 13:40:29.460445 23769 leader_election.cc:341] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:29.461401 23772 leader_election.cc:302] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:29.461169 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:29.462323 23931 raft_consensus.cc:2781] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:29.462978 23931 raft_consensus.cc:482] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:29.463822 23931 raft_consensus.cc:3037] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:29.467617 23881 raft_consensus.cc:348] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.468182 23881 raft_consensus.cc:374] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:29.469811 23888 tablet_bootstrap.cc:654] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
W20260807 13:40:29.462929 23772 leader_election.cc:341] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:29.468658 23881 raft_consensus.cc:729] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:29.472851 23450 catalog_manager.cc:5495] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 0 to 1, leader changed from <none> to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 1 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
W20260807 13:40:29.475657 23769 leader_election.cc:341] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:29.477319 23769 leader_election.cc:302] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:29.478237 23884 tablet_bootstrap.cc:654] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:29.478557 24032 raft_consensus.cc:2726] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:29.482262 23881 consensus_queue.cc:260] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.485455 23881 ts_tablet_manager.cc:1428] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.055s user 0.010s sys 0.000s
I20260807 13:40:29.486624 23881 tablet_bootstrap.cc:492] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:29.496134 23931 raft_consensus.cc:504] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.506022 23881 tablet_bootstrap.cc:654] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:29.507692 23931 leader_election.cc:288] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:29.509778 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:29.510103 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:29.511059 23600 raft_consensus.cc:3037] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:40:29.511696 23769 leader_election.cc:341] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:29.512154 23884 tablet_bootstrap.cc:492] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:29.512673 23884 ts_tablet_manager.cc:1397] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.068s user 0.010s sys 0.010s
I20260807 13:40:29.515241 23450 catalog_manager.cc:5495] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 0 to 1, leader changed from <none> to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 1 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:29.524992 23600 raft_consensus.cc:2454] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:29.526190 23888 tablet_bootstrap.cc:492] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:29.526875 23888 ts_tablet_manager.cc:1397] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.113s user 0.017s sys 0.009s
I20260807 13:40:29.527173 23772 leader_election.cc:302] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:29.528637 23931 raft_consensus.cc:2781] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:29.529309 23931 raft_consensus.cc:686] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:29.530050 23884 raft_consensus.cc:348] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.530934 23884 raft_consensus.cc:374] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:29.530390 23931 consensus_queue.cc:237] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.531245 23884 raft_consensus.cc:729] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:29.532192 23884 consensus_queue.cc:260] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.535008 23884 ts_tablet_manager.cc:1428] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.022s user 0.011s sys 0.000s
W20260807 13:40:29.547796 23554 consensus_peers.cc:487] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 -> Peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Couldn't send request to peer d28e736aee9f4f01b013de670a762697. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:40:29.547343 23888 raft_consensus.cc:348] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.549856 23888 raft_consensus.cc:374] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:29.550433 23888 raft_consensus.cc:729] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:29.551755 23881 tablet_bootstrap.cc:492] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:29.552242 23881 ts_tablet_manager.cc:1397] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.066s user 0.009s sys 0.018s
I20260807 13:40:29.552057 23888 consensus_queue.cc:260] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.551807 23884 tablet_bootstrap.cc:492] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:29.556082 23881 raft_consensus.cc:348] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.556835 23881 raft_consensus.cc:374] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:29.557121 23881 raft_consensus.cc:729] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:29.559029 23881 consensus_queue.cc:260] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.561833 23888 ts_tablet_manager.cc:1428] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.035s user 0.008s sys 0.003s
I20260807 13:40:29.562978 23888 tablet_bootstrap.cc:492] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:29.567893 23448 catalog_manager.cc:5495] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 0 to 1, leader changed from <none> to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 1 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:29.573632 23881 ts_tablet_manager.cc:1428] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.021s user 0.008s sys 0.000s
I20260807 13:40:29.573989 23888 tablet_bootstrap.cc:654] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:29.574759 23881 tablet_bootstrap.cc:492] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:29.587968 23884 tablet_bootstrap.cc:654] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:29.606236 23931 raft_consensus.cc:482] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:29.607409 23931 raft_consensus.cc:504] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.615563 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:29.619185 23909 consensus_queue.cc:1035] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260807 13:40:29.621353 23772 leader_election.cc:341] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:29.622229 23888 tablet_bootstrap.cc:492] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:29.622972 23888 ts_tablet_manager.cc:1397] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.060s user 0.014s sys 0.041s
I20260807 13:40:29.625923 23884 tablet_bootstrap.cc:492] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:29.626596 23884 ts_tablet_manager.cc:1397] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.075s user 0.019s sys 0.025s
I20260807 13:40:29.627051 23931 leader_election.cc:288] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:29.628723 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:29.630640 23769 leader_election.cc:341] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:29.631652 23769 leader_election.cc:302] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:29.633618 23931 raft_consensus.cc:2726] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:29.633925 23884 raft_consensus.cc:348] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.636008 23884 raft_consensus.cc:374] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:29.636341 23884 raft_consensus.cc:729] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:29.640218 23888 raft_consensus.cc:348] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.641228 23888 raft_consensus.cc:374] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:29.641599 23888 raft_consensus.cc:729] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:29.643373 23884 consensus_queue.cc:260] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.644428 23881 tablet_bootstrap.cc:654] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:29.646054 23884 ts_tablet_manager.cc:1428] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.019s user 0.002s sys 0.005s
I20260807 13:40:29.647154 23884 tablet_bootstrap.cc:492] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:29.651244 23909 raft_consensus.cc:482] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:29.652164 23909 raft_consensus.cc:504] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.658278 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:29.659170 23710 raft_consensus.cc:2379] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 1: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:29.663512 23888 consensus_queue.cc:260] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.676208 23884 tablet_bootstrap.cc:654] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:29.681195 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:29.682582 23909 leader_election.cc:288] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:29.683528 23958 raft_consensus.cc:482] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:29.683753 23554 leader_election.cc:302] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:29.684731 24014 raft_consensus.cc:3037] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:29.684165 23958 raft_consensus.cc:504] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.687382 23888 ts_tablet_manager.cc:1428] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.064s user 0.004s sys 0.011s
I20260807 13:40:29.687506 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:29.688489 23888 tablet_bootstrap.cc:492] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
W20260807 13:40:29.689471 23662 leader_election.cc:341] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:29.691396 23958 leader_election.cc:288] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:29.695659 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:29.697000 23660 leader_election.cc:341] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:29.697554 23660 leader_election.cc:302] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:29.698376 23890 raft_consensus.cc:2726] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:29.698975 24014 raft_consensus.cc:2726] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:29.719115 23888 tablet_bootstrap.cc:654] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:29.719964 23884 tablet_bootstrap.cc:492] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:29.720182 23881 tablet_bootstrap.cc:492] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:29.720443 23884 ts_tablet_manager.cc:1397] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.074s user 0.014s sys 0.008s
I20260807 13:40:29.720906 23881 ts_tablet_manager.cc:1397] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.146s user 0.028s sys 0.023s
I20260807 13:40:29.722534 23884 raft_consensus.cc:348] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.723201 23884 raft_consensus.cc:374] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:29.723443 23884 raft_consensus.cc:729] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:29.724085 23884 consensus_queue.cc:260] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.725211 23881 raft_consensus.cc:348] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.726071 23881 raft_consensus.cc:374] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:29.726202 23884 ts_tablet_manager.cc:1428] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260807 13:40:29.726359 23881 raft_consensus.cc:729] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:29.727233 23888 tablet_bootstrap.cc:492] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:29.727640 23884 tablet_bootstrap.cc:492] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:29.727730 23888 ts_tablet_manager.cc:1397] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.039s user 0.006s sys 0.007s
I20260807 13:40:29.727190 23881 consensus_queue.cc:260] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.732177 23881 ts_tablet_manager.cc:1428] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.011s user 0.001s sys 0.009s
I20260807 13:40:29.733142 23881 tablet_bootstrap.cc:492] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:29.733327 24014 raft_consensus.cc:482] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:29.734257 23884 tablet_bootstrap.cc:654] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:29.734079 24014 raft_consensus.cc:504] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.743865 23958 raft_consensus.cc:482] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:29.744576 23958 raft_consensus.cc:504] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.753933 23888 raft_consensus.cc:348] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.755390 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:29.759804 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:29.760509 23710 raft_consensus.cc:2454] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 0.
W20260807 13:40:29.762610 23554 leader_election.cc:341] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:29.754997 23888 raft_consensus.cc:374] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:29.766008 23888 raft_consensus.cc:729] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:29.768399 23555 leader_election.cc:302] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:29.765167 23970 consensus_queue.cc:1035] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260807 13:40:29.771001 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:29.769223 23958 leader_election.cc:288] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:29.776101 23662 consensus_peers.cc:487] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 -> Peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Couldn't send request to peer 08757cfbeffb41bbab14c2ef00e9d812. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:40:29.771639 23888 consensus_queue.cc:260] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.756095 24014 leader_election.cc:288] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:29.786330 23825 raft_consensus.cc:2379] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 1: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:29.786880 23909 raft_consensus.cc:2781] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:29.809255 23881 tablet_bootstrap.cc:654] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:29.803761 23909 raft_consensus.cc:482] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:29.806053 24014 raft_consensus.cc:482] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:29.807363 23931 raft_consensus.cc:482] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:29.822753 23888 ts_tablet_manager.cc:1428] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.095s user 0.022s sys 0.004s
I20260807 13:40:29.826175 23888 tablet_bootstrap.cc:492] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:29.828567 23931 raft_consensus.cc:504] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.839263 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:29.820009 23909 raft_consensus.cc:3037] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:29.826870 24014 raft_consensus.cc:504] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.857286 24014 leader_election.cc:288] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:29.860951 23931 leader_election.cc:288] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:29.869683 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:29.872052 23710 raft_consensus.cc:2454] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:29.874454 23769 leader_election.cc:302] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:29.876557 23931 raft_consensus.cc:2781] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:29.877090 23931 raft_consensus.cc:482] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:29.883423 23931 raft_consensus.cc:3037] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:29.888929 24032 consensus_queue.cc:1035] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:40:29.893237 24063 consensus_queue.cc:1035] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:29.896472 23909 raft_consensus.cc:504] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.900650 23970 raft_consensus.cc:482] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:29.905441 23970 raft_consensus.cc:504] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.907634 23909 leader_election.cc:288] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:29.911669 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:29.911458 23931 raft_consensus.cc:504] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.912744 23970 leader_election.cc:288] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:29.913988 23931 leader_election.cc:288] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:29.916199 23888 tablet_bootstrap.cc:654] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:29.902139 23884 tablet_bootstrap.cc:492] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:29.904654 23881 tablet_bootstrap.cc:492] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:29.918596 23881 ts_tablet_manager.cc:1397] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.186s user 0.011s sys 0.013s
I20260807 13:40:29.918499 23884 ts_tablet_manager.cc:1397] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.191s user 0.016s sys 0.012s
I20260807 13:40:29.918720 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:29.920053 23709 raft_consensus.cc:3037] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:29.924878 23884 raft_consensus.cc:348] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.925736 23884 raft_consensus.cc:374] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:29.926033 23884 raft_consensus.cc:729] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:29.930706 23881 raft_consensus.cc:348] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.932300 23881 raft_consensus.cc:374] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:29.931246 23884 consensus_queue.cc:260] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.934644 23881 raft_consensus.cc:729] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:29.935946 23881 consensus_queue.cc:260] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:29.939620 23884 ts_tablet_manager.cc:1428] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.020s user 0.007s sys 0.001s
I20260807 13:40:29.940766 23884 tablet_bootstrap.cc:492] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:29.952788 23881 ts_tablet_manager.cc:1428] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.034s user 0.009s sys 0.003s
I20260807 13:40:29.955116 23881 tablet_bootstrap.cc:492] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:29.987450 23884 tablet_bootstrap.cc:654] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:29.981917 23709 raft_consensus.cc:2454] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:29.994442 23769 leader_election.cc:302] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:29.998637 24032 raft_consensus.cc:2781] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:30.000334 23881 tablet_bootstrap.cc:654] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:30.000464 24032 raft_consensus.cc:686] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:30.001921 24032 consensus_queue.cc:237] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:30.082046 23888 tablet_bootstrap.cc:492] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
W20260807 13:40:30.076305 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 56330.5us
I20260807 13:40:30.129287 23711 raft_consensus.cc:3037] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:30.166929 23888 ts_tablet_manager.cc:1397] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.341s user 0.040s sys 0.068s
I20260807 13:40:30.167145 23884 tablet_bootstrap.cc:492] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:30.167845 23884 ts_tablet_manager.cc:1397] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.227s user 0.023s sys 0.016s
I20260807 13:40:30.167632 24032 raft_consensus.cc:482] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:30.173051 24032 raft_consensus.cc:504] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:30.175496 24032 leader_election.cc:288] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:30.175621 23888 raft_consensus.cc:348] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:30.176577 23888 raft_consensus.cc:374] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:30.176935 23888 raft_consensus.cc:729] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:30.177599 24116 consensus_queue.cc:1035] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:30.177625 23888 consensus_queue.cc:260] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:30.179590 23888 ts_tablet_manager.cc:1428] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.012s user 0.006s sys 0.002s
I20260807 13:40:30.179728 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:30.180634 23888 tablet_bootstrap.cc:492] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:30.188387 23884 raft_consensus.cc:348] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:30.189371 23884 raft_consensus.cc:374] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:30.189776 23884 raft_consensus.cc:729] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:30.957845 24120 raft_consensus.cc:482] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:30.959512 24120 raft_consensus.cc:504] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:30.962365 24120 leader_election.cc:288] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:30.965869 24118 raft_consensus.cc:482] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:30.966609 24118 raft_consensus.cc:504] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:30.969197 24118 leader_election.cc:288] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:30.980219 24122 raft_consensus.cc:482] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:30.980278 24118 raft_consensus.cc:482] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:30.981042 24122 raft_consensus.cc:504] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:30.981228 24118 raft_consensus.cc:504] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:30.983456 24118 leader_election.cc:288] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:30.983397 24122 leader_election.cc:288] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:31.024412 23888 tablet_bootstrap.cc:654] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:31.031025 23881 tablet_bootstrap.cc:492] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:31.033674 23881 ts_tablet_manager.cc:1397] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 1.079s user 0.039s sys 0.035s
I20260807 13:40:31.031975 24118 raft_consensus.cc:482] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:31.037087 24118 raft_consensus.cc:504] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.038101 23881 raft_consensus.cc:348] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.039991 24118 leader_election.cc:288] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:31.046973 24118 raft_consensus.cc:482] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:31.047938 24118 raft_consensus.cc:504] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.039706 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:31.043845 23890 raft_consensus.cc:482] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:31.050628 23890 raft_consensus.cc:504] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.053319 23890 leader_election.cc:288] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:31.060343 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:31.063378 23600 raft_consensus.cc:3037] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:31.062075 23662 leader_election.cc:302] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:31.067572 23884 consensus_queue.cc:260] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.070572 23890 raft_consensus.cc:3037] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:31.071563 23884 ts_tablet_manager.cc:1428] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.903s user 0.012s sys 0.011s
W20260807 13:40:31.072182 23884 ts_tablet_manager.cc:1460] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37: Tablet startup took 903ms
I20260807 13:40:31.072688 24118 leader_election.cc:288] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:31.054633 23881 raft_consensus.cc:374] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:31.078009 23881 raft_consensus.cc:729] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
W20260807 13:40:31.072763 23884 ts_tablet_manager.cc:1462] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37: Trace:
0807 13:40:25.527082 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:26.198893 (+671811us) service_pool.cc:227] Handling call
0807 13:40:26.234410 (+ 35517us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:26.234512 (+ 102us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:26.310543 (+ 76031us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:26.337927 (+ 27384us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:26.372552 (+ 34625us) inbound_call.cc:173] Queueing success response
0807 13:40:29.940399 (+3567847us) ts_tablet_manager.cc:1373] Bootstrapping tablet
0807 13:40:30.168148 (+227749us) ts_tablet_manager.cc:1429] Starting tablet replica
0807 13:40:30.186088 (+ 17940us) tablet_replica.cc:259] Starting instrumentation
0807 13:40:30.187174 (+ 1086us) tablet_replica.cc:278] Starting consensus
Metrics: {"raft.queue_time_us":2927,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":282,"tablet-open.queue_time_us":3568759}
I20260807 13:40:31.078917 24118 raft_consensus.cc:482] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:31.080824 23881 consensus_queue.cc:260] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.054436 24122 raft_consensus.cc:482] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:31.095908 24122 raft_consensus.cc:504] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.098017 24122 leader_election.cc:288] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:31.098382 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:31.100780 23710 raft_consensus.cc:2454] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 0.
I20260807 13:40:31.103075 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:31.103484 23890 raft_consensus.cc:2726] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:31.103916 23707 raft_consensus.cc:3037] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:31.105361 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:31.105571 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 914309us
I20260807 13:40:31.107205 23601 raft_consensus.cc:3037] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:31.108846 23970 raft_consensus.cc:482] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:31.109550 23970 raft_consensus.cc:504] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.095366 24118 raft_consensus.cc:504] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.113879 24127 raft_consensus.cc:482] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:31.114825 24127 raft_consensus.cc:504] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.115917 24118 leader_election.cc:288] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:31.116534 24118 raft_consensus.cc:482] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:31.117570 24127 leader_election.cc:288] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:31.117086 24118 raft_consensus.cc:504] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.119371 23888 tablet_bootstrap.cc:492] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:31.119261 23909 raft_consensus.cc:482] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:31.120079 23888 ts_tablet_manager.cc:1397] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.940s user 0.085s sys 0.144s
I20260807 13:40:31.120059 24118 leader_election.cc:288] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:31.120134 23909 raft_consensus.cc:504] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
I20260807 13:40:31.112701 23970 leader_election.cc:288] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:31.123529 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:31.098613 24122 raft_consensus.cc:482] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:31.128341 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:31.136189 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:31.137005 24122 raft_consensus.cc:504] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:31.139695 23535 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:40:31.140663 23909 leader_election.cc:288] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:31.141386 23888 raft_consensus.cc:348] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.142201 23888 raft_consensus.cc:374] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:31.143514 23449 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37968 (request call id 43) took 1358 ms. Trace:
I20260807 13:40:31.143879 23449 rpcz_store.cc:276] 0807 13:40:30.933765 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:30.934190 (+ 425us) service_pool.cc:227] Handling call
0807 13:40:31.143260 (+209070us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7269,"reported_tablets":1}
I20260807 13:40:31.142462 23888 raft_consensus.cc:729] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:31.147631 23888 consensus_queue.cc:260] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.146553 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:31.152693 23888 ts_tablet_manager.cc:1428] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.032s user 0.007s sys 0.002s
I20260807 13:40:31.154260 23888 tablet_bootstrap.cc:492] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:31.155481 23709 raft_consensus.cc:2454] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:31.160534 23448 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37962 (request call id 48) took 1081 ms. Trace:
I20260807 13:40:31.160949 23448 rpcz_store.cc:276] 0807 13:40:30.083858 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:30.084795 (+ 937us) service_pool.cc:227] Handling call
0807 13:40:31.160211 (+1075416us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":95819,"reported_tablets":4}
I20260807 13:40:31.162955 24031 raft_consensus.cc:482] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:31.163663 24031 raft_consensus.cc:504] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.175887 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:31.176697 23820 raft_consensus.cc:2454] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:31.179502 24122 leader_election.cc:288] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:31.179842 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:31.180614 23823 raft_consensus.cc:2454] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:31.182794 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:31.184528 23881 ts_tablet_manager.cc:1428] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.150s user 0.006s sys 0.006s
I20260807 13:40:31.188752 23881 tablet_bootstrap.cc:492] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:31.195611 23884 tablet_bootstrap.cc:492] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:31.201913 23711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 69) took 1009 ms. Trace:
I20260807 13:40:31.202450 23711 rpcz_store.cc:276] 0807 13:40:30.192962 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:30.195147 (+ 2185us) service_pool.cc:227] Handling call
0807 13:40:31.024269 (+829122us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:31.025127 (+ 858us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:31.025181 (+ 54us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:31.103331 (+ 78150us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b2c00005cf8. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461aa90e11 00007f461aaa0442 00007f461c0e8c11 00007f461c0ad58a 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772
0807 13:40:31.103832 (+ 501us) log.cc:842] Serialized 26 byte log entry
0807 13:40:31.185569 (+ 81737us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:40:31.186289 (+ 720us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:31.192356 (+ 6067us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:31.201384 (+ 9028us) raft_consensus.cc:1671] finished
0807 13:40:31.201418 (+ 34us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:31.201692 (+ 274us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":13587,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":286,"spinlock_wait_cycles":16205696,"thread_start_us":62541,"threads_started":1,"wal-append.queue_time_us":94680}
I20260807 13:40:31.204172 23707 raft_consensus.cc:2454] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:31.204926 24031 leader_election.cc:288] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:31.208065 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:31.208456 23660 leader_election.cc:302] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:31.208873 23823 raft_consensus.cc:2454] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 0.
I20260807 13:40:31.210598 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:31.211035 23970 raft_consensus.cc:2781] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:31.211575 23970 raft_consensus.cc:482] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:31.212052 23970 raft_consensus.cc:3037] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:31.210096 23660 leader_election.cc:302] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:31.215723 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:31.217780 24090 raft_consensus.cc:2781] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:31.218205 24090 raft_consensus.cc:482] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:40:31.218441 23660 leader_election.cc:341] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:31.218971 23600 raft_consensus.cc:2379] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 1: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:31.218578 24090 raft_consensus.cc:3037] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:31.226435 23970 raft_consensus.cc:504] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.217278 23823 raft_consensus.cc:3037] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:31.228488 24090 raft_consensus.cc:504] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.230782 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:31.231827 23600 raft_consensus.cc:2454] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:31.240013 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:31.240013 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:31.243603 24090 leader_election.cc:288] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:31.254982 23888 tablet_bootstrap.cc:654] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:31.254803 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:31.255367 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:31.255820 23597 raft_consensus.cc:3037] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:31.256728 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:31.256536 23448 catalog_manager.cc:5495] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 0 to 1, leader changed from <none> to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 1 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:31.258303 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:31.260319 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:31.262176 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:31.264096 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:31.266193 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:31.242278 23970 leader_election.cc:288] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:31.269217 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:31.271329 23597 raft_consensus.cc:2454] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
W20260807 13:40:31.272583 23772 leader_election.cc:341] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:31.272626 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:31.276757 23772 leader_election.cc:341] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:31.277791 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:31.281041 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:31.281497 23884 tablet_bootstrap.cc:654] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:31.283437 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:31.287563 24031 consensus_queue.cc:1035] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:40:31.286593 23931 consensus_queue.cc:1035] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:31.278890 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:31.286568 23772 leader_election.cc:302] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:31.301563 24031 consensus_queue.cc:1035] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:31.304207 23881 tablet_bootstrap.cc:654] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:31.312916 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:31.317744 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:31.318766 23769 leader_election.cc:302] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:31.320449 24105 raft_consensus.cc:2781] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:31.321928 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:31.322407 24105 raft_consensus.cc:482] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:31.322834 24105 raft_consensus.cc:3037] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:31.323987 24063 raft_consensus.cc:2726] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:31.325313 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:31.328696 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:31.329834 23662 leader_election.cc:302] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:31.331538 23970 raft_consensus.cc:2726] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:31.331460 23931 consensus_queue.cc:1035] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:40:31.333910 23888 tablet_bootstrap.cc:492] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:31.334271 23888 ts_tablet_manager.cc:1397] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.180s user 0.014s sys 0.002s
I20260807 13:40:31.336449 24132 raft_consensus.cc:482] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
W20260807 13:40:31.336655 23662 leader_election.cc:341] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:31.337131 24132 raft_consensus.cc:504] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:31.338740 23662 leader_election.cc:341] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:31.338505 23888 raft_consensus.cc:348] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.339357 23888 raft_consensus.cc:374] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:31.339885 24132 leader_election.cc:288] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:31.339661 23888 raft_consensus.cc:729] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
W20260807 13:40:31.340353 23662 leader_election.cc:341] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:31.340879 23662 leader_election.cc:302] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:31.340791 23888 consensus_queue.cc:260] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.341892 23970 raft_consensus.cc:2726] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:31.343441 23888 ts_tablet_manager.cc:1428] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.009s user 0.006s sys 0.001s
I20260807 13:40:31.341804 24105 raft_consensus.cc:504] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.352161 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:31.353012 23703 raft_consensus.cc:2454] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:31.362210 23888 tablet_bootstrap.cc:492] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:31.363811 23555 leader_election.cc:302] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:31.370872 24122 raft_consensus.cc:2741] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260807 13:40:31.371630 24122 consensus_queue.cc:1035] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260807 13:40:31.372270 23554 leader_election.cc:341] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:31.373601 23555 leader_election.cc:302] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:31.373771 23909 consensus_queue.cc:1035] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:31.375073 24118 raft_consensus.cc:2781] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:31.375716 24118 raft_consensus.cc:686] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:31.376894 24118 consensus_queue.cc:237] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.378268 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:31.379199 23823 raft_consensus.cc:2379] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 1: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:31.380579 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:31.381207 23823 raft_consensus.cc:3037] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:31.387538 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:31.388152 23769 leader_election.cc:302] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:31.390249 24063 raft_consensus.cc:2781] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:31.394714 24063 raft_consensus.cc:482] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:31.394946 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:31.395220 24063 raft_consensus.cc:3037] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:31.395859 23601 raft_consensus.cc:2379] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 1: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:31.402782 23823 raft_consensus.cc:2454] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:31.403927 23888 tablet_bootstrap.cc:654] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:31.398613 23554 leader_election.cc:302] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:31.407223 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:31.408630 23597 raft_consensus.cc:2454] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:31.409897 23660 leader_election.cc:302] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:31.411027 24122 raft_consensus.cc:2726] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:31.411453 23554 leader_election.cc:302] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:31.412081 23970 raft_consensus.cc:2781] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:31.412616 23970 raft_consensus.cc:686] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:31.414702 23554 leader_election.cc:302] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:31.398581 24105 leader_election.cc:288] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:31.415630 23909 raft_consensus.cc:2726] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:31.417728 23554 leader_election.cc:302] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:31.418841 23909 raft_consensus.cc:2726] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:31.419423 23554 leader_election.cc:302] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:31.418486 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:31.422886 23554 leader_election.cc:302] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:31.424934 23909 raft_consensus.cc:2726] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:31.415205 23970 consensus_queue.cc:237] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.430423 24131 raft_consensus.cc:2726] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:31.429466 23703 raft_consensus.cc:2379] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 1: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:31.433708 23554 leader_election.cc:302] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:31.435286 23881 tablet_bootstrap.cc:492] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:31.435763 23881 ts_tablet_manager.cc:1397] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.247s user 0.020s sys 0.015s
I20260807 13:40:31.432571 23662 leader_election.cc:302] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:31.437889 24122 raft_consensus.cc:2726] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:31.438786 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:31.444108 23599 raft_consensus.cc:2379] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 1: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:31.444532 24090 raft_consensus.cc:2781] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:31.445045 24090 raft_consensus.cc:686] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:31.445436 23554 leader_election.cc:302] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:31.446282 24132 raft_consensus.cc:2726] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:31.445931 24090 consensus_queue.cc:237] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.453260 23884 tablet_bootstrap.cc:492] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:31.453384 23554 leader_election.cc:302] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:31.453804 23884 ts_tablet_manager.cc:1397] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.259s user 0.016s sys 0.013s
I20260807 13:40:31.455462 23554 leader_election.cc:302] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:31.439818 24118 raft_consensus.cc:2726] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:31.458391 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:31.457332 23909 raft_consensus.cc:2726] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:31.456869 24122 raft_consensus.cc:2726] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:31.461035 23881 raft_consensus.cc:348] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.466428 23881 raft_consensus.cc:374] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:31.466759 23881 raft_consensus.cc:729] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:31.471089 23881 consensus_queue.cc:260] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:31.466034 23772 consensus_peers.cc:487] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 -> Peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Couldn't send request to peer 08757cfbeffb41bbab14c2ef00e9d812. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:40:31.478323 23884 raft_consensus.cc:348] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.479126 23884 raft_consensus.cc:374] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:31.479393 23884 raft_consensus.cc:729] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:31.480017 23884 consensus_queue.cc:260] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.482393 23884 ts_tablet_manager.cc:1428] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.028s user 0.004s sys 0.000s
I20260807 13:40:31.503062 23555 leader_election.cc:302] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:31.501354 23772 leader_election.cc:302] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:31.504069 24118 raft_consensus.cc:2726] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:31.505081 24105 raft_consensus.cc:2726] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:40:31.506321 23884 tablet_bootstrap.cc:492] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:31.506721 23881 ts_tablet_manager.cc:1428] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.066s user 0.008s sys 0.002s
I20260807 13:40:31.515793 24127 raft_consensus.cc:482] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:31.517868 23881 tablet_bootstrap.cc:492] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:31.524525 23881 tablet_bootstrap.cc:654] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:31.488330 24063 raft_consensus.cc:504] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.527719 24127 raft_consensus.cc:504] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.546475 23888 tablet_bootstrap.cc:492] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:31.547094 23888 ts_tablet_manager.cc:1397] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.202s user 0.010s sys 0.053s
I20260807 13:40:31.550231 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:31.550958 23711 raft_consensus.cc:3037] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:31.550824 23888 raft_consensus.cc:348] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.551600 23888 raft_consensus.cc:374] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:31.553051 23888 raft_consensus.cc:729] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:31.559527 23888 consensus_queue.cc:260] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.546262 24063 leader_election.cc:288] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:31.573840 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:31.574582 23598 raft_consensus.cc:3037] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:31.589843 23888 ts_tablet_manager.cc:1428] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.042s user 0.003s sys 0.005s
I20260807 13:40:31.600740 24127 leader_election.cc:288] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:31.611735 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:31.615513 23884 tablet_bootstrap.cc:654] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:31.621197 23888 tablet_bootstrap.cc:492] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:31.621006 23711 raft_consensus.cc:2454] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
W20260807 13:40:31.625850 23662 leader_election.cc:341] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:31.629264 23769 leader_election.cc:302] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:31.630620 23599 raft_consensus.cc:3037] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:40:31.631320 23634 debug-util.cc:398] Leaking SignalData structure 0x7b0800132100 after lost signal to thread 21836
I20260807 13:40:31.632231 24063 raft_consensus.cc:2781] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:31.632840 24063 raft_consensus.cc:686] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
W20260807 13:40:31.633232 23634 debug-util.cc:398] Leaking SignalData structure 0x7b08000df380 after lost signal to thread 23513
W20260807 13:40:31.635414 23634 debug-util.cc:398] Leaking SignalData structure 0x7b0800107500 after lost signal to thread 23637
W20260807 13:40:31.636562 23634 debug-util.cc:398] Leaking SignalData structure 0x7b08001501e0 after lost signal to thread 23751
I20260807 13:40:31.636946 23888 tablet_bootstrap.cc:654] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
W20260807 13:40:31.637614 23634 debug-util.cc:398] Leaking SignalData structure 0x7b08001988a0 after lost signal to thread 23861
I20260807 13:40:31.633730 24063 consensus_queue.cc:237] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:31.654062 23634 debug-util.cc:398] Leaking SignalData structure 0x7b08001060a0 after lost signal to thread 24014
W20260807 13:40:31.656026 23634 debug-util.cc:398] Leaking SignalData structure 0x7b0800084760 after lost signal to thread 24059
W20260807 13:40:31.656332 23634 debug-util.cc:398] Leaking SignalData structure 0x7b08001329e0 after lost signal to thread 24060
W20260807 13:40:31.656575 23634 debug-util.cc:398] Leaking SignalData structure 0x7b0800145000 after lost signal to thread 24062
W20260807 13:40:31.656818 23634 debug-util.cc:398] Leaking SignalData structure 0x7b08001d5b60 after lost signal to thread 24064
W20260807 13:40:31.657075 23634 debug-util.cc:398] Leaking SignalData structure 0x7b08000b1e20 after lost signal to thread 24070
W20260807 13:40:31.657354 23634 debug-util.cc:398] Leaking SignalData structure 0x7b0800148700 after lost signal to thread 24085
W20260807 13:40:31.657601 23634 debug-util.cc:398] Leaking SignalData structure 0x7b08000d3ba0 after lost signal to thread 24088
I20260807 13:40:31.658560 23448 catalog_manager.cc:5495] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 0 to 1, leader changed from <none> to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 1 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:31.666764 24132 raft_consensus.cc:482] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:31.667344 24132 raft_consensus.cc:504] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.668241 23881 tablet_bootstrap.cc:492] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:31.668875 23881 ts_tablet_manager.cc:1397] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.151s user 0.016s sys 0.035s
I20260807 13:40:31.669337 24132 leader_election.cc:288] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:31.670866 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:31.672650 23598 raft_consensus.cc:2454] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:31.673411 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:31.674429 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:31.675258 23703 raft_consensus.cc:2454] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 0.
I20260807 13:40:31.676374 23823 raft_consensus.cc:2454] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 0.
I20260807 13:40:31.677115 23555 leader_election.cc:302] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:31.678238 24122 raft_consensus.cc:2781] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:31.678591 24122 raft_consensus.cc:482] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:31.679538 24122 raft_consensus.cc:3037] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:40:31.681860 23660 leader_election.cc:341] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:31.682289 23660 leader_election.cc:302] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:31.683940 24176 raft_consensus.cc:2726] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:31.689173 23881 raft_consensus.cc:348] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.690759 23881 raft_consensus.cc:374] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:31.690932 23888 tablet_bootstrap.cc:492] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:31.691051 23881 raft_consensus.cc:729] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:31.691417 23888 ts_tablet_manager.cc:1397] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.082s user 0.019s sys 0.017s
I20260807 13:40:31.691864 23881 consensus_queue.cc:260] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.694378 23888 raft_consensus.cc:348] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.695111 23888 raft_consensus.cc:374] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:31.695385 23888 raft_consensus.cc:729] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:31.694002 24122 raft_consensus.cc:504] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.696058 23888 consensus_queue.cc:260] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.697395 23931 raft_consensus.cc:482] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:31.697887 23931 raft_consensus.cc:504] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.697765 23450 catalog_manager.cc:5495] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 1 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:31.699676 23450 catalog_manager.cc:5495] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 1 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:31.700613 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:31.701756 23703 raft_consensus.cc:3037] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:31.702783 23881 ts_tablet_manager.cc:1428] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.034s user 0.009s sys 0.000s
I20260807 13:40:31.703928 23881 tablet_bootstrap.cc:492] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:31.700783 23931 leader_election.cc:288] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:31.701037 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:31.709499 23769 leader_election.cc:341] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:31.709839 23888 ts_tablet_manager.cc:1428] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.018s user 0.006s sys 0.000s
I20260807 13:40:31.710386 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:31.712608 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
W20260807 13:40:31.712999 23772 leader_election.cc:341] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:31.713299 23820 raft_consensus.cc:3037] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:31.713604 23772 leader_election.cc:302] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:31.714775 23888 tablet_bootstrap.cc:492] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:31.715157 23931 raft_consensus.cc:2726] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:31.709493 23703 raft_consensus.cc:2454] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:31.717519 24122 leader_election.cc:288] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:31.731839 23820 raft_consensus.cc:2454] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:31.735852 23554 leader_election.cc:302] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:31.736867 24122 raft_consensus.cc:2781] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:31.737557 24122 raft_consensus.cc:686] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:31.738492 24122 consensus_queue.cc:237] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.739677 24132 raft_consensus.cc:482] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:31.740182 24132 raft_consensus.cc:504] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.741997 24132 leader_election.cc:288] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:31.742887 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:31.744499 23555 leader_election.cc:341] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:31.745641 23881 tablet_bootstrap.cc:654] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:31.750316 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:31.751761 23554 leader_election.cc:341] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:31.752254 23554 leader_election.cc:302] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:31.753448 24132 raft_consensus.cc:2726] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:31.752708 23449 catalog_manager.cc:5495] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 0 to 1, leader changed from <none> to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 1 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:31.759943 23884 tablet_bootstrap.cc:492] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:31.760524 23884 ts_tablet_manager.cc:1397] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.265s user 0.009s sys 0.019s
I20260807 13:40:31.764884 23884 raft_consensus.cc:348] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.768572 23884 raft_consensus.cc:374] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:31.768962 23884 raft_consensus.cc:729] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:31.769694 23884 consensus_queue.cc:260] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.762321 23888 tablet_bootstrap.cc:654] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:31.770983 23881 tablet_bootstrap.cc:492] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:31.771607 23881 ts_tablet_manager.cc:1397] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.068s user 0.008s sys 0.005s
I20260807 13:40:31.775019 23881 raft_consensus.cc:348] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.775765 23881 raft_consensus.cc:374] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:31.776046 23881 raft_consensus.cc:729] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:31.776643 23881 consensus_queue.cc:260] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.784845 23448 catalog_manager.cc:5495] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 0 to 1, leader changed from <none> to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 1 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:31.778527 23881 ts_tablet_manager.cc:1428] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260807 13:40:31.790619 23881 tablet_bootstrap.cc:492] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:31.800387 23884 ts_tablet_manager.cc:1428] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.038s user 0.005s sys 0.001s
I20260807 13:40:31.805285 23884 tablet_bootstrap.cc:492] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:31.808955 23881 tablet_bootstrap.cc:654] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:31.816252 23888 tablet_bootstrap.cc:492] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:31.816722 23888 ts_tablet_manager.cc:1397] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.102s user 0.014s sys 0.000s
I20260807 13:40:31.819337 23888 raft_consensus.cc:348] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.820052 23888 raft_consensus.cc:374] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:31.820297 23888 raft_consensus.cc:729] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:31.820861 23888 consensus_queue.cc:260] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.823823 23884 tablet_bootstrap.cc:654] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:31.829015 23888 ts_tablet_manager.cc:1428] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.012s user 0.008s sys 0.000s
I20260807 13:40:31.830058 23888 tablet_bootstrap.cc:492] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:31.839407 23888 tablet_bootstrap.cc:654] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:31.843710 23881 tablet_bootstrap.cc:492] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:31.844250 23881 ts_tablet_manager.cc:1397] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.054s user 0.012s sys 0.001s
I20260807 13:40:31.847129 23884 tablet_bootstrap.cc:492] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:31.847470 23888 tablet_bootstrap.cc:492] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:31.847605 23884 ts_tablet_manager.cc:1397] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.043s user 0.008s sys 0.004s
I20260807 13:40:31.848008 23888 ts_tablet_manager.cc:1397] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.018s user 0.010s sys 0.000s
I20260807 13:40:31.848198 23881 raft_consensus.cc:348] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.849002 23881 raft_consensus.cc:374] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:31.849282 23881 raft_consensus.cc:729] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:31.849987 23881 consensus_queue.cc:260] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.850282 23884 raft_consensus.cc:348] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.851017 23884 raft_consensus.cc:374] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:31.851358 23884 raft_consensus.cc:729] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:31.850914 23888 raft_consensus.cc:348] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.851996 23888 raft_consensus.cc:374] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:31.852335 23888 raft_consensus.cc:729] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:31.852111 23884 consensus_queue.cc:260] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.853193 23888 consensus_queue.cc:260] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.855549 23888 ts_tablet_manager.cc:1428] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 13:40:31.856653 23888 tablet_bootstrap.cc:492] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:31.858280 23884 ts_tablet_manager.cc:1428] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.010s user 0.005s sys 0.001s
I20260807 13:40:31.863955 23881 ts_tablet_manager.cc:1428] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.019s user 0.007s sys 0.000s
I20260807 13:40:31.864957 23881 tablet_bootstrap.cc:492] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:31.865743 23888 tablet_bootstrap.cc:654] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:31.861362 23884 tablet_bootstrap.cc:492] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:31.877925 23888 tablet_bootstrap.cc:492] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:31.878572 23888 ts_tablet_manager.cc:1397] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.022s user 0.012s sys 0.005s
I20260807 13:40:31.870501 23881 tablet_bootstrap.cc:654] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:31.881378 23884 tablet_bootstrap.cc:654] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:31.881937 23888 raft_consensus.cc:348] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.882493 23888 raft_consensus.cc:374] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:31.882892 23888 raft_consensus.cc:729] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:31.883641 23888 consensus_queue.cc:260] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.884107 23970 raft_consensus.cc:482] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:31.884649 23970 raft_consensus.cc:504] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.886511 23888 ts_tablet_manager.cc:1428] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260807 13:40:31.886952 23970 leader_election.cc:288] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:31.888603 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:31.891198 23662 leader_election.cc:341] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:31.891517 23888 tablet_bootstrap.cc:492] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:31.891769 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:31.897951 23660 leader_election.cc:341] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:31.898427 23660 leader_election.cc:302] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:31.899673 23970 raft_consensus.cc:2726] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:31.899770 24090 raft_consensus.cc:482] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:31.900327 23970 consensus_queue.cc:1035] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:40:31.900242 24090 raft_consensus.cc:504] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.906270 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:31.907008 23599 raft_consensus.cc:2454] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:31.908763 23662 leader_election.cc:302] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:31.909637 23970 raft_consensus.cc:2781] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:31.909981 23970 raft_consensus.cc:482] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:31.910287 23970 raft_consensus.cc:3037] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:31.907573 24090 leader_election.cc:288] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:31.916200 23884 tablet_bootstrap.cc:492] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:31.916700 23884 ts_tablet_manager.cc:1397] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.056s user 0.001s sys 0.009s
I20260807 13:40:31.920876 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:31.921543 23884 raft_consensus.cc:348] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.922295 23884 raft_consensus.cc:374] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:31.922547 23884 raft_consensus.cc:729] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:31.923271 23884 consensus_queue.cc:260] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.929348 23888 tablet_bootstrap.cc:654] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:31.929436 23884 ts_tablet_manager.cc:1428] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.012s user 0.007s sys 0.000s
I20260807 13:40:31.921829 23820 raft_consensus.cc:2454] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:31.943449 23884 tablet_bootstrap.cc:492] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:31.931535 23970 raft_consensus.cc:504] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.946009 23820 raft_consensus.cc:3037] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:31.952772 23881 tablet_bootstrap.cc:492] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:31.953293 23881 ts_tablet_manager.cc:1397] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.089s user 0.009s sys 0.006s
I20260807 13:40:31.955991 24090 consensus_queue.cc:1035] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:31.957587 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:31.958339 23599 raft_consensus.cc:3037] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:31.958730 23970 leader_election.cc:288] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:31.961889 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:31.966423 23825 raft_consensus.cc:3037] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:31.968252 23884 tablet_bootstrap.cc:654] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:31.970866 23888 tablet_bootstrap.cc:492] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:31.971333 23888 ts_tablet_manager.cc:1397] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.080s user 0.015s sys 0.002s
I20260807 13:40:31.973726 24090 consensus_queue.cc:1035] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:40:31.972940 23881 raft_consensus.cc:348] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.979949 23881 raft_consensus.cc:374] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:31.973718 23888 raft_consensus.cc:348] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.980651 23888 raft_consensus.cc:374] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:31.980930 23888 raft_consensus.cc:729] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:31.980219 23825 raft_consensus.cc:2454] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:31.980326 23881 raft_consensus.cc:729] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:31.982887 23888 consensus_queue.cc:260] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.985869 23881 consensus_queue.cc:260] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.986924 23660 leader_election.cc:302] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:31.987783 24090 raft_consensus.cc:2781] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:31.988252 24090 raft_consensus.cc:686] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:31.989051 24090 consensus_queue.cc:237] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:31.993112 23881 ts_tablet_manager.cc:1428] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.040s user 0.005s sys 0.003s
I20260807 13:40:31.993368 24122 consensus_queue.cc:1035] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:31.994616 23881 tablet_bootstrap.cc:492] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:31.995857 23970 raft_consensus.cc:482] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:31.997519 23970 raft_consensus.cc:504] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.001246 23888 ts_tablet_manager.cc:1428] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.030s user 0.005s sys 0.003s
I20260807 13:40:32.003909 23888 tablet_bootstrap.cc:492] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:32.003675 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:32.004419 23600 raft_consensus.cc:2454] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:32.007231 23662 leader_election.cc:302] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:32.008224 24176 raft_consensus.cc:2781] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:32.013149 24176 raft_consensus.cc:482] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:32.014331 24176 raft_consensus.cc:3037] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:32.018766 24122 consensus_queue.cc:1035] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260807 13:40:32.027705 24176 raft_consensus.cc:504] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.018301 23970 leader_election.cc:288] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:32.037029 24176 leader_election.cc:288] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:32.038129 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:32.041471 23600 raft_consensus.cc:3037] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:32.044507 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:32.046614 23823 raft_consensus.cc:2454] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:32.048384 23599 raft_consensus.cc:2454] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:32.060029 24178 raft_consensus.cc:482] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:32.060899 24178 raft_consensus.cc:504] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.063814 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:32.065047 23823 raft_consensus.cc:3037] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:32.081332 24178 leader_election.cc:288] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:32.082052 24122 raft_consensus.cc:482] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:32.081959 23600 raft_consensus.cc:2454] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:32.087023 23881 tablet_bootstrap.cc:654] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:32.089730 24122 raft_consensus.cc:504] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.094297 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:32.098006 24122 leader_election.cc:288] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:32.109331 23597 raft_consensus.cc:2454] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:32.125562 23888 tablet_bootstrap.cc:654] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:32.133422 23662 leader_election.cc:302] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
W20260807 13:40:32.134840 23662 consensus_peers.cc:487] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 -> Peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Couldn't send request to peer 08757cfbeffb41bbab14c2ef00e9d812. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:40:32.136237 23449 catalog_manager.cc:5495] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 1 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:32.146443 23662 leader_election.cc:302] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:32.151882 23970 raft_consensus.cc:2781] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:32.152390 23970 raft_consensus.cc:482] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:32.152788 23970 raft_consensus.cc:3037] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:32.160419 24063 raft_consensus.cc:482] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:32.161459 24063 raft_consensus.cc:504] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.166867 24063 leader_election.cc:288] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:32.167927 23884 tablet_bootstrap.cc:492] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:32.139389 24090 raft_consensus.cc:2781] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:32.168416 23884 ts_tablet_manager.cc:1397] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.229s user 0.007s sys 0.020s
W20260807 13:40:32.166880 24200 log.cc:924] Time spent T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.158s user 0.000s sys 0.002s
I20260807 13:40:32.173768 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:32.174726 23817 raft_consensus.cc:2454] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:32.175173 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:32.177011 23554 leader_election.cc:341] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:32.176831 24105 consensus_queue.cc:1035] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:32.179158 23823 raft_consensus.cc:2454] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:32.180330 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:32.185420 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:32.172389 24090 raft_consensus.cc:686] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:32.190024 23884 raft_consensus.cc:348] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.191845 23884 raft_consensus.cc:374] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:32.192163 23884 raft_consensus.cc:729] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:32.198990 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:32.200116 23599 raft_consensus.cc:2454] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:32.206646 23884 consensus_queue.cc:260] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.209702 23772 leader_election.cc:302] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
W20260807 13:40:32.212486 23555 leader_election.cc:341] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:32.213234 23555 leader_election.cc:302] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:32.213964 23931 raft_consensus.cc:2781] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:32.214411 23931 raft_consensus.cc:482] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:32.214802 23931 raft_consensus.cc:3037] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:32.214742 24118 raft_consensus.cc:2726] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:32.215401 24090 consensus_queue.cc:237] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.218565 23884 ts_tablet_manager.cc:1428] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.049s user 0.007s sys 0.000s
I20260807 13:40:32.219813 23884 tablet_bootstrap.cc:492] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:32.232627 23888 tablet_bootstrap.cc:492] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:32.233193 23888 ts_tablet_manager.cc:1397] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.230s user 0.010s sys 0.018s
I20260807 13:40:32.227825 23931 raft_consensus.cc:504] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.240137 23970 raft_consensus.cc:504] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.249758 23881 tablet_bootstrap.cc:492] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:32.250332 23881 ts_tablet_manager.cc:1397] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.256s user 0.019s sys 0.004s
I20260807 13:40:32.253196 23970 leader_election.cc:288] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:32.249881 23888 raft_consensus.cc:348] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.255528 23931 leader_election.cc:288] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:32.255868 23888 raft_consensus.cc:374] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:32.256174 23888 raft_consensus.cc:729] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
W20260807 13:40:32.258520 23769 leader_election.cc:341] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:32.259351 23888 consensus_queue.cc:260] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.253749 23881 raft_consensus.cc:348] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.262238 23881 raft_consensus.cc:374] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:32.262614 23881 raft_consensus.cc:729] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:32.265981 23881 consensus_queue.cc:260] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.277860 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:32.278770 23818 raft_consensus.cc:3037] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:32.286247 23881 ts_tablet_manager.cc:1428] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.036s user 0.009s sys 0.000s
I20260807 13:40:32.283031 23888 ts_tablet_manager.cc:1428] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.049s user 0.005s sys 0.005s
I20260807 13:40:32.292537 23881 tablet_bootstrap.cc:492] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:32.306747 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:32.307502 23600 raft_consensus.cc:3037] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:32.300700 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:32.317997 23888 tablet_bootstrap.cc:492] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:32.318557 23884 tablet_bootstrap.cc:654] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:32.322849 23931 consensus_queue.cc:1035] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:40:32.321544 23597 raft_consensus.cc:3037] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:32.342343 24132 consensus_queue.cc:1035] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260807 13:40:32.340080 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:32.352090 23448 catalog_manager.cc:5495] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 1 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
W20260807 13:40:32.359941 23769 leader_election.cc:341] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:32.364943 24090 raft_consensus.cc:482] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:32.365641 24090 raft_consensus.cc:504] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.367857 24118 consensus_queue.cc:1035] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:32.372457 24118 raft_consensus.cc:482] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:32.373257 24118 raft_consensus.cc:504] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.379343 23818 raft_consensus.cc:2454] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:32.393422 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:32.395547 23554 leader_election.cc:341] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:32.395974 23597 raft_consensus.cc:2454] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:32.396242 23660 leader_election.cc:302] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:32.397187 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:32.403267 24210 raft_consensus.cc:2781] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election won for term 1
W20260807 13:40:32.405211 23555 leader_election.cc:341] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:32.406534 23555 leader_election.cc:302] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:32.407480 24132 raft_consensus.cc:2726] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:32.409111 24210 raft_consensus.cc:686] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:32.411484 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:32.390220 24118 leader_election.cc:288] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:32.413230 23881 tablet_bootstrap.cc:654] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
W20260807 13:40:32.413309 23662 leader_election.cc:341] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:32.410388 24210 consensus_queue.cc:237] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.418286 24090 leader_election.cc:288] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:32.419909 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:32.421864 23888 tablet_bootstrap.cc:654] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
W20260807 13:40:32.423249 23660 leader_election.cc:341] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:32.420379 23600 raft_consensus.cc:2454] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:32.424145 23660 leader_election.cc:302] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:32.431699 23772 leader_election.cc:302] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:32.432817 23931 raft_consensus.cc:2781] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:32.433341 23931 raft_consensus.cc:686] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:32.432739 24090 raft_consensus.cc:2726] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:32.433931 23931 consensus_queue.cc:237] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:32.453606 23535 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:40:32.465533 24214 raft_consensus.cc:482] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:32.475920 23449 catalog_manager.cc:5495] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 1 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:32.466581 24214 raft_consensus.cc:504] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.495288 24214 leader_election.cc:288] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:32.497437 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:32.505483 23772 leader_election.cc:341] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:32.508342 23884 tablet_bootstrap.cc:492] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:32.498986 24210 consensus_queue.cc:1035] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:32.512331 23884 ts_tablet_manager.cc:1397] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.293s user 0.014s sys 0.007s
I20260807 13:40:32.515832 23888 tablet_bootstrap.cc:492] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:32.516314 23888 ts_tablet_manager.cc:1397] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.201s user 0.011s sys 0.019s
I20260807 13:40:32.515707 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:32.527608 23881 tablet_bootstrap.cc:492] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:32.528280 23881 ts_tablet_manager.cc:1397] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.236s user 0.017s sys 0.021s
I20260807 13:40:32.532899 23881 raft_consensus.cc:348] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:32.535126 23769 leader_election.cc:341] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:32.543766 23769 leader_election.cc:302] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:32.545727 24105 raft_consensus.cc:2726] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:32.544323 23970 consensus_queue.cc:1035] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260807 13:40:32.546584 23881 raft_consensus.cc:374] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:32.547464 23881 raft_consensus.cc:729] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:32.548792 23881 consensus_queue.cc:260] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.551015 23884 raft_consensus.cc:348] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.551852 23884 raft_consensus.cc:374] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:32.552183 23884 raft_consensus.cc:729] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:32.552922 23884 consensus_queue.cc:260] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.556524 23884 ts_tablet_manager.cc:1428] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.044s user 0.007s sys 0.000s
I20260807 13:40:32.557651 23884 tablet_bootstrap.cc:492] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:32.558813 23888 raft_consensus.cc:348] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.567097 23888 raft_consensus.cc:374] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:32.568177 23888 raft_consensus.cc:729] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:32.569651 23888 consensus_queue.cc:260] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.563544 23881 ts_tablet_manager.cc:1428] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.034s user 0.008s sys 0.000s
I20260807 13:40:32.571988 23884 tablet_bootstrap.cc:654] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:32.581518 23881 tablet_bootstrap.cc:492] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:32.594755 23888 ts_tablet_manager.cc:1428] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.078s user 0.010s sys 0.000s
I20260807 13:40:32.595965 24090 raft_consensus.cc:482] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:32.597718 23449 catalog_manager.cc:5495] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 0 to 1, leader changed from <none> to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 1 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:32.601610 23888 tablet_bootstrap.cc:492] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:32.597007 24090 raft_consensus.cc:504] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.613620 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:32.616873 24090 leader_election.cc:288] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:32.617939 23662 leader_election.cc:341] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:32.619324 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:32.620272 23818 raft_consensus.cc:2454] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:32.627393 23660 leader_election.cc:302] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:32.629904 24210 raft_consensus.cc:2781] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:32.630604 24210 raft_consensus.cc:482] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:32.631500 24210 raft_consensus.cc:3037] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:32.657047 24210 raft_consensus.cc:504] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.661088 23970 consensus_queue.cc:1035] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:32.688858 23884 tablet_bootstrap.cc:492] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:32.689385 23884 ts_tablet_manager.cc:1397] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.132s user 0.016s sys 0.028s
I20260807 13:40:32.693243 23881 tablet_bootstrap.cc:654] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:32.684509 23970 consensus_queue.cc:1035] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260807 13:40:32.695653 23884 raft_consensus.cc:348] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.696532 23884 raft_consensus.cc:374] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:32.696841 23884 raft_consensus.cc:729] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:32.697564 24210 leader_election.cc:288] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:32.701561 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:32.702639 23820 raft_consensus.cc:3037] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:32.704233 23884 consensus_queue.cc:260] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.707690 23884 ts_tablet_manager.cc:1428] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.018s user 0.005s sys 0.004s
I20260807 13:40:32.733606 23884 tablet_bootstrap.cc:492] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:32.737782 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:32.763425 23888 tablet_bootstrap.cc:654] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
W20260807 13:40:32.767041 23662 leader_election.cc:341] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:32.776955 23884 tablet_bootstrap.cc:654] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:32.787143 23820 raft_consensus.cc:2454] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:32.791489 23660 leader_election.cc:302] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:32.792954 23970 raft_consensus.cc:2781] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:32.793877 23970 raft_consensus.cc:686] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:32.795310 23970 consensus_queue.cc:237] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.808650 23888 tablet_bootstrap.cc:492] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:32.809340 23888 ts_tablet_manager.cc:1397] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.208s user 0.019s sys 0.009s
I20260807 13:40:32.817680 23888 raft_consensus.cc:348] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.818424 23888 raft_consensus.cc:374] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:32.818696 23888 raft_consensus.cc:729] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:32.819255 23888 consensus_queue.cc:260] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.820487 23448 catalog_manager.cc:5495] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 1 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:32.822160 24178 consensus_queue.cc:1035] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:40:32.821583 23888 ts_tablet_manager.cc:1428] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.012s user 0.006s sys 0.002s
I20260807 13:40:32.827804 23888 tablet_bootstrap.cc:492] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:32.829380 23884 tablet_bootstrap.cc:492] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:32.829849 23884 ts_tablet_manager.cc:1397] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.099s user 0.009s sys 0.012s
I20260807 13:40:32.834010 23884 raft_consensus.cc:348] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.834877 23884 raft_consensus.cc:374] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:32.835554 23884 raft_consensus.cc:729] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:32.836853 23884 consensus_queue.cc:260] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.834743 24214 consensus_queue.cc:1035] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260807 13:40:32.840392 23970 raft_consensus.cc:482] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:32.841485 23970 raft_consensus.cc:504] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.842109 23884 ts_tablet_manager.cc:1428] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.012s user 0.005s sys 0.004s
I20260807 13:40:32.843328 23884 tablet_bootstrap.cc:492] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:32.849695 23881 tablet_bootstrap.cc:492] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:32.846361 23970 leader_election.cc:288] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:32.848483 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:32.855733 23881 ts_tablet_manager.cc:1397] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.274s user 0.016s sys 0.017s
I20260807 13:40:32.853523 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:32.856424 23600 raft_consensus.cc:2454] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:32.858037 23662 leader_election.cc:302] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:32.859731 23888 tablet_bootstrap.cc:654] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:32.862164 24178 raft_consensus.cc:2781] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260807 13:40:32.863400 23660 leader_election.cc:341] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:32.865057 24178 raft_consensus.cc:482] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:32.863593 23881 raft_consensus.cc:348] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.865713 23881 raft_consensus.cc:374] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:32.865993 23881 raft_consensus.cc:729] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:32.866644 24178 raft_consensus.cc:3037] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:32.870455 23881 consensus_queue.cc:260] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.879616 23881 ts_tablet_manager.cc:1428] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.023s user 0.004s sys 0.003s
I20260807 13:40:32.880682 23881 tablet_bootstrap.cc:492] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:32.891840 24178 raft_consensus.cc:504] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.898779 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:32.899694 23881 tablet_bootstrap.cc:654] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:32.901705 23884 tablet_bootstrap.cc:654] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:32.901333 23599 raft_consensus.cc:3037] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:40:32.915542 23769 consensus_peers.cc:487] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 -> Peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Couldn't send request to peer 8a3af1d071e74f2eb0c821e2bd68fe37. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:40:32.935532 23888 tablet_bootstrap.cc:492] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:32.943636 23888 ts_tablet_manager.cc:1397] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.116s user 0.013s sys 0.010s
I20260807 13:40:32.944905 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:32.942780 24178 leader_election.cc:288] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:32.946502 23660 leader_election.cc:341] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:32.957104 23599 raft_consensus.cc:2454] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:32.963503 24105 raft_consensus.cc:482] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:32.964385 24105 raft_consensus.cc:504] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.965400 23888 raft_consensus.cc:348] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.966310 23888 raft_consensus.cc:374] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:32.960695 23970 consensus_queue.cc:1035] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:32.971138 23888 raft_consensus.cc:729] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:32.974432 23888 consensus_queue.cc:260] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.976982 23662 leader_election.cc:302] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:32.981194 24105 leader_election.cc:288] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:32.981411 24178 raft_consensus.cc:2781] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:32.988585 24178 raft_consensus.cc:686] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:33.001609 24178 consensus_queue.cc:237] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:32.998791 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:33.004452 23703 raft_consensus.cc:2454] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:33.006157 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:33.009579 23888 ts_tablet_manager.cc:1428] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.065s user 0.005s sys 0.004s
I20260807 13:40:33.013666 23598 raft_consensus.cc:2454] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:33.017717 23772 leader_election.cc:302] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:33.018033 23881 tablet_bootstrap.cc:492] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:33.021751 24214 raft_consensus.cc:2781] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:33.022409 24214 raft_consensus.cc:482] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:33.023070 24214 raft_consensus.cc:3037] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:33.021746 23881 ts_tablet_manager.cc:1397] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.141s user 0.010s sys 0.048s
I20260807 13:40:33.028277 24122 raft_consensus.cc:482] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:33.029021 24122 raft_consensus.cc:504] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.034924 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:33.039037 24132 raft_consensus.cc:482] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:33.038959 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:33.040007 23703 raft_consensus.cc:2454] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 0.
I20260807 13:40:33.039680 24132 raft_consensus.cc:504] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:33.042062 23554 leader_election.cc:341] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:33.044463 24132 leader_election.cc:288] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:33.046937 23555 leader_election.cc:302] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:33.040730 24122 leader_election.cc:288] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:33.049121 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:33.050205 24122 raft_consensus.cc:2781] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:33.050611 24122 raft_consensus.cc:482] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:33.051011 24122 raft_consensus.cc:3037] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:33.051151 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:33.053030 23554 leader_election.cc:302] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:33.053503 23888 tablet_bootstrap.cc:492] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:33.054603 24132 raft_consensus.cc:2726] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:33.057920 23597 raft_consensus.cc:3037] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:33.059751 24214 raft_consensus.cc:504] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.063923 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:33.064740 23703 raft_consensus.cc:3037] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:33.065704 23881 raft_consensus.cc:348] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.066464 23881 raft_consensus.cc:374] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:33.066781 23881 raft_consensus.cc:729] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:33.067816 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:33.068572 23598 raft_consensus.cc:3037] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:33.073752 23884 tablet_bootstrap.cc:492] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:33.074313 23884 ts_tablet_manager.cc:1397] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.231s user 0.024s sys 0.028s
I20260807 13:40:33.075769 23881 consensus_queue.cc:260] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.076170 23703 raft_consensus.cc:2454] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:33.078099 23769 leader_election.cc:302] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:33.080754 24063 raft_consensus.cc:2781] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:33.081300 24063 raft_consensus.cc:686] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:33.083174 24122 raft_consensus.cc:504] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.085924 24063 consensus_queue.cc:237] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.089291 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:33.090108 23703 raft_consensus.cc:3037] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:33.062393 24214 leader_election.cc:288] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:33.094517 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:33.095201 23881 ts_tablet_manager.cc:1428] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.071s user 0.006s sys 0.001s
I20260807 13:40:33.096347 23881 tablet_bootstrap.cc:492] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
W20260807 13:40:33.097122 23554 leader_election.cc:341] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:33.097813 23598 raft_consensus.cc:2454] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:33.098676 23888 tablet_bootstrap.cc:654] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:33.100971 24122 leader_election.cc:288] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:33.111230 23884 raft_consensus.cc:348] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.117920 23881 tablet_bootstrap.cc:654] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:33.118513 23448 catalog_manager.cc:5495] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 1 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:33.120191 23703 raft_consensus.cc:2454] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:33.121342 23884 raft_consensus.cc:374] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:33.121881 23884 raft_consensus.cc:729] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:33.122514 23884 consensus_queue.cc:260] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.124898 23884 ts_tablet_manager.cc:1428] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.050s user 0.006s sys 0.000s
I20260807 13:40:33.125995 23884 tablet_bootstrap.cc:492] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:33.131891 23555 leader_election.cc:302] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:33.134430 24122 raft_consensus.cc:2781] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:33.135218 24122 raft_consensus.cc:686] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:33.136229 24122 consensus_queue.cc:237] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.144160 23448 catalog_manager.cc:5495] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 0 to 1, leader changed from <none> to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 1 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:33.153331 23888 tablet_bootstrap.cc:492] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:33.153831 23888 ts_tablet_manager.cc:1397] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.101s user 0.015s sys 0.015s
I20260807 13:40:33.163596 23888 raft_consensus.cc:348] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.164394 23888 raft_consensus.cc:374] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:33.164691 23888 raft_consensus.cc:729] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:33.165419 23888 consensus_queue.cc:260] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.167565 23888 ts_tablet_manager.cc:1428] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.013s user 0.004s sys 0.004s
I20260807 13:40:33.168696 23888 tablet_bootstrap.cc:492] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:33.201594 23888 tablet_bootstrap.cc:654] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:33.205669 23884 tablet_bootstrap.cc:654] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:33.220709 24063 raft_consensus.cc:482] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:33.221416 24063 raft_consensus.cc:504] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.228415 24063 leader_election.cc:288] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:33.233906 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:33.236392 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:33.236363 23449 catalog_manager.cc:5495] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 0 to 1, leader changed from <none> to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 1 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:33.238584 23600 raft_consensus.cc:2454] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:33.247351 23881 tablet_bootstrap.cc:492] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:33.247985 23881 ts_tablet_manager.cc:1397] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.152s user 0.005s sys 0.026s
W20260807 13:40:33.241614 23769 leader_election.cc:341] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:33.254508 23772 leader_election.cc:302] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:33.254644 23881 raft_consensus.cc:348] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.255496 23881 raft_consensus.cc:374] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:33.255766 23881 raft_consensus.cc:729] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:33.256158 24214 raft_consensus.cc:2781] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:33.256757 24214 raft_consensus.cc:482] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:33.256711 23881 consensus_queue.cc:260] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.257402 24214 raft_consensus.cc:3037] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:33.260111 23881 ts_tablet_manager.cc:1428] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.012s user 0.009s sys 0.000s
I20260807 13:40:33.261780 23881 tablet_bootstrap.cc:492] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:33.262034 23970 raft_consensus.cc:482] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:33.262740 23970 raft_consensus.cc:504] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.269079 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:33.273610 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:33.274468 23597 raft_consensus.cc:2454] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:33.275521 23970 leader_election.cc:288] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:33.276378 23660 leader_election.cc:341] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:33.277333 23662 leader_election.cc:302] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:33.281684 23970 raft_consensus.cc:2781] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:33.282213 23970 raft_consensus.cc:482] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:33.282738 23970 raft_consensus.cc:3037] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:33.283488 23888 tablet_bootstrap.cc:492] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:33.284195 23888 ts_tablet_manager.cc:1397] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.116s user 0.019s sys 0.035s
I20260807 13:40:33.290930 23888 raft_consensus.cc:348] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.291458 23888 raft_consensus.cc:374] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:33.291673 23888 raft_consensus.cc:729] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
W20260807 13:40:33.296264 23662 consensus_peers.cc:487] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 -> Peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Couldn't send request to peer 08757cfbeffb41bbab14c2ef00e9d812. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:40:33.292204 23888 consensus_queue.cc:260] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.301723 23884 tablet_bootstrap.cc:492] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:33.302256 23884 ts_tablet_manager.cc:1397] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.177s user 0.018s sys 0.035s
I20260807 13:40:33.309870 23888 ts_tablet_manager.cc:1428] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.025s user 0.005s sys 0.001s
I20260807 13:40:33.314550 23884 raft_consensus.cc:348] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.315629 23884 raft_consensus.cc:374] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:33.316000 23884 raft_consensus.cc:729] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:33.316745 23884 consensus_queue.cc:260] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.319187 23888 tablet_bootstrap.cc:492] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:33.321305 24214 raft_consensus.cc:504] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.344137 23881 tablet_bootstrap.cc:654] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:33.344727 23884 ts_tablet_manager.cc:1428] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.042s user 0.005s sys 0.002s
I20260807 13:40:33.345687 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:33.346177 24214 leader_election.cc:288] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:33.346379 23597 raft_consensus.cc:3037] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:33.347919 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
W20260807 13:40:33.349248 23769 leader_election.cc:341] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:33.350409 23884 tablet_bootstrap.cc:492] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:33.355132 23888 tablet_bootstrap.cc:654] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:33.359515 23970 raft_consensus.cc:504] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.360286 23597 raft_consensus.cc:2454] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:33.360504 24210 consensus_queue.cc:1035] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:40:33.361410 23772 leader_election.cc:302] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:33.361572 23970 leader_election.cc:288] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:33.362282 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:33.362903 23597 raft_consensus.cc:3037] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:33.366132 24063 raft_consensus.cc:2781] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:33.366986 24063 raft_consensus.cc:686] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:33.367808 24063 consensus_queue.cc:237] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.370862 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
W20260807 13:40:33.373466 23660 leader_election.cc:341] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:33.381522 23888 tablet_bootstrap.cc:492] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:33.382077 23888 ts_tablet_manager.cc:1397] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.063s user 0.010s sys 0.007s
I20260807 13:40:33.383116 23884 tablet_bootstrap.cc:654] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:33.398298 23597 raft_consensus.cc:2454] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:33.401551 23662 leader_election.cc:302] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:33.403399 23970 raft_consensus.cc:2781] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:33.404274 23970 raft_consensus.cc:686] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:33.406055 23970 consensus_queue.cc:237] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.418270 23888 raft_consensus.cc:348] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.419303 23888 raft_consensus.cc:374] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:33.419618 23888 raft_consensus.cc:729] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:33.420401 23888 consensus_queue.cc:260] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.422967 23888 ts_tablet_manager.cc:1428] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.041s user 0.012s sys 0.000s
I20260807 13:40:33.432709 23818 raft_consensus.cc:3037] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:33.437083 23597 raft_consensus.cc:3037] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:33.440560 23888 tablet_bootstrap.cc:492] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:33.452311 23881 tablet_bootstrap.cc:492] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:33.452874 23881 ts_tablet_manager.cc:1397] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.191s user 0.024s sys 0.033s
I20260807 13:40:33.489073 23881 raft_consensus.cc:348] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.489777 23970 raft_consensus.cc:482] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:33.490456 23970 raft_consensus.cc:504] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.493536 24105 raft_consensus.cc:482] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:33.494280 23970 leader_election.cc:288] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:33.494215 24105 raft_consensus.cc:504] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.496236 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:33.498045 23662 leader_election.cc:341] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:33.489851 23881 raft_consensus.cc:374] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:33.499212 23881 raft_consensus.cc:729] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:33.499869 23881 consensus_queue.cc:260] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.502216 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:33.503127 23599 raft_consensus.cc:2454] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:33.504632 23772 leader_election.cc:302] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:33.504678 23449 catalog_manager.cc:5495] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 1 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:33.505892 24214 raft_consensus.cc:2781] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:33.506224 24214 raft_consensus.cc:482] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:33.506548 24214 raft_consensus.cc:3037] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:33.501118 23448 catalog_manager.cc:5495] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 0 to 1, leader changed from <none> to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 1 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:33.512786 24105 leader_election.cc:288] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:33.514168 23931 raft_consensus.cc:482] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:33.517442 23931 raft_consensus.cc:504] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.519310 23931 leader_election.cc:288] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:33.519676 23888 tablet_bootstrap.cc:654] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:33.521055 24122 raft_consensus.cc:482] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:33.521572 24122 raft_consensus.cc:504] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.524209 23881 ts_tablet_manager.cc:1428] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.071s user 0.007s sys 0.007s
I20260807 13:40:33.539460 24178 consensus_queue.cc:1035] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:33.525664 24122 leader_election.cc:288] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:33.542003 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:33.542091 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:33.543426 23702 raft_consensus.cc:2454] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:33.529749 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:33.546132 23555 leader_election.cc:341] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:33.524333 24214 raft_consensus.cc:504] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.552382 24178 consensus_queue.cc:1035] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:33.554059 24214 leader_election.cc:288] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:33.527885 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:33.556211 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:33.556879 23818 raft_consensus.cc:2454] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:33.557686 24210 raft_consensus.cc:482] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:33.558269 24210 raft_consensus.cc:504] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.558820 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:33.563777 23881 tablet_bootstrap.cc:492] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:33.575176 24210 leader_election.cc:288] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:33.575874 23820 raft_consensus.cc:1226] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
W20260807 13:40:33.578547 23772 leader_election.cc:341] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:33.582496 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:33.585168 23769 leader_election.cc:302] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:33.583400 23600 raft_consensus.cc:3037] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:33.587533 23660 leader_election.cc:302] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:33.592468 23970 raft_consensus.cc:2781] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260807 13:40:33.588378 23554 leader_election.cc:341] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:33.592844 23970 raft_consensus.cc:482] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:33.593232 23970 raft_consensus.cc:3037] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:33.593194 23554 leader_election.cc:302] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:33.594813 24090 consensus_queue.cc:1046] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:33.595929 24090 raft_consensus.cc:3032] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:33.596426 24090 raft_consensus.cc:729] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:33.590171 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:33.596271 24122 raft_consensus.cc:2726] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:33.597646 24090 consensus_queue.cc:260] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.589495 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:33.602627 23970 raft_consensus.cc:504] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:33.603343 23660 leader_election.cc:341] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:33.605577 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:33.606310 23884 tablet_bootstrap.cc:492] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:33.606905 23884 ts_tablet_manager.cc:1397] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.257s user 0.021s sys 0.025s
I20260807 13:40:33.607757 23970 leader_election.cc:288] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:33.610424 24090 raft_consensus.cc:3037] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:33.612634 23931 consensus_queue.cc:1035] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:40:33.614583 23662 leader_election.cc:341] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:33.615496 23662 leader_election.cc:302] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:33.617033 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:33.617442 24176 raft_consensus.cc:2726] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:33.623502 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:33.624096 23600 raft_consensus.cc:2454] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:33.600183 24214 raft_consensus.cc:2781] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:33.620720 23884 raft_consensus.cc:348] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.627663 23884 raft_consensus.cc:374] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:33.627980 23884 raft_consensus.cc:729] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:33.628680 23884 consensus_queue.cc:260] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.635913 23599 raft_consensus.cc:1226] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260807 13:40:33.636490 23884 ts_tablet_manager.cc:1428] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.029s user 0.006s sys 0.001s
I20260807 13:40:33.639688 23888 tablet_bootstrap.cc:492] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:33.640143 23888 ts_tablet_manager.cc:1397] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.209s user 0.016s sys 0.005s
I20260807 13:40:33.640285 24105 consensus_queue.cc:1035] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:40:33.643877 23554 consensus_peers.cc:487] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 -> Peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Couldn't send request to peer d28e736aee9f4f01b013de670a762697. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:40:33.645345 23884 tablet_bootstrap.cc:492] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:33.651244 23888 raft_consensus.cc:348] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.651842 23888 raft_consensus.cc:374] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:33.652096 23888 raft_consensus.cc:729] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:33.652802 23888 consensus_queue.cc:260] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.653645 23881 tablet_bootstrap.cc:654] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:33.631373 24214 raft_consensus.cc:482] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:33.650902 23772 leader_election.cc:302] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:33.659251 24105 raft_consensus.cc:2781] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:33.659804 24105 raft_consensus.cc:686] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
W20260807 13:40:33.660714 23662 leader_election.cc:341] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:33.660683 24105 consensus_queue.cc:237] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.665416 23703 raft_consensus.cc:2396] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 13:40:33.668790 24214 raft_consensus.cc:3037] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:33.672211 23888 ts_tablet_manager.cc:1428] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.032s user 0.009s sys 0.000s
W20260807 13:40:33.675179 23535 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:40:33.687235 23888 tablet_bootstrap.cc:492] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:33.709756 23449 catalog_manager.cc:5495] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 1 to 2, leader changed from 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66) to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 2 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:33.720068 24122 consensus_queue.cc:1035] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:33.734979 23884 tablet_bootstrap.cc:654] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:33.739163 23888 tablet_bootstrap.cc:654] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:33.743806 24214 raft_consensus.cc:504] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.745971 23820 raft_consensus.cc:2379] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 1: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:33.747936 24214 leader_election.cc:288] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:33.749064 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:33.750038 23597 raft_consensus.cc:3037] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:33.751065 23660 leader_election.cc:302] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:33.751886 24178 raft_consensus.cc:2726] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:40:33.753659 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:33.756150 23707 raft_consensus.cc:2379] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 1: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:33.757490 23881 tablet_bootstrap.cc:492] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:33.757938 23881 ts_tablet_manager.cc:1397] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.194s user 0.011s sys 0.031s
I20260807 13:40:33.761562 23881 raft_consensus.cc:348] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.762347 23881 raft_consensus.cc:374] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:33.769626 23881 raft_consensus.cc:729] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:33.770923 23881 consensus_queue.cc:260] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.772773 23597 raft_consensus.cc:2454] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:33.778218 23772 leader_election.cc:302] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:33.785038 23931 raft_consensus.cc:2781] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:33.785573 23931 raft_consensus.cc:686] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:33.786288 23931 consensus_queue.cc:237] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.786921 24090 raft_consensus.cc:482] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:33.787551 24090 raft_consensus.cc:504] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.793166 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:33.796864 23881 ts_tablet_manager.cc:1428] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.039s user 0.005s sys 0.004s
W20260807 13:40:33.800859 23662 leader_election.cc:341] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:33.801452 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:33.799180 24090 leader_election.cc:288] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:33.802325 23820 raft_consensus.cc:2454] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:33.802799 23881 tablet_bootstrap.cc:492] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:33.807135 23660 leader_election.cc:302] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:33.809851 24090 raft_consensus.cc:2781] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:33.810827 24090 raft_consensus.cc:482] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:33.811266 24090 raft_consensus.cc:3037] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:40:33.838590 23660 consensus_peers.cc:487] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 -> Peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Couldn't send request to peer d28e736aee9f4f01b013de670a762697. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260807 13:40:33.838590 23769 consensus_peers.cc:487] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 -> Peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Couldn't send request to peer 8a3af1d071e74f2eb0c821e2bd68fe37. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:40:33.853121 24176 consensus_queue.cc:1035] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:33.871407 23449 catalog_manager.cc:5495] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 0 to 1, leader changed from <none> to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 1 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:33.905321 23888 tablet_bootstrap.cc:492] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:33.905835 23888 ts_tablet_manager.cc:1397] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.219s user 0.022s sys 0.007s
I20260807 13:40:33.908749 24090 raft_consensus.cc:504] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.911310 23884 tablet_bootstrap.cc:492] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:33.911847 23884 ts_tablet_manager.cc:1397] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.267s user 0.047s sys 0.052s
I20260807 13:40:33.913969 24090 leader_election.cc:288] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:33.913383 23888 raft_consensus.cc:348] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.915194 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:33.922610 23820 raft_consensus.cc:3037] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:33.922199 23888 raft_consensus.cc:374] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:33.923372 23888 raft_consensus.cc:729] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:33.924116 23888 consensus_queue.cc:260] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.916472 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:33.926426 23888 ts_tablet_manager.cc:1428] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.020s user 0.001s sys 0.005s
I20260807 13:40:33.931895 23888 tablet_bootstrap.cc:492] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:33.927189 23881 tablet_bootstrap.cc:654] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:33.916750 23884 raft_consensus.cc:348] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.934896 23884 raft_consensus.cc:374] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:33.935206 23884 raft_consensus.cc:729] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:33.935930 23884 consensus_queue.cc:260] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.937574 23888 tablet_bootstrap.cc:654] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:33.942444 23884 ts_tablet_manager.cc:1428] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.030s user 0.007s sys 0.002s
I20260807 13:40:33.944079 23884 tablet_bootstrap.cc:492] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
W20260807 13:40:33.945618 23662 leader_election.cc:341] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:33.953250 23820 raft_consensus.cc:2454] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:33.954879 23660 leader_election.cc:302] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:33.955664 24090 raft_consensus.cc:2781] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:33.956419 24090 raft_consensus.cc:686] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:33.960597 24090 consensus_queue.cc:237] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.972470 23888 tablet_bootstrap.cc:492] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:33.973174 23888 ts_tablet_manager.cc:1397] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.010s
I20260807 13:40:33.972509 23881 tablet_bootstrap.cc:492] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:33.974521 23881 ts_tablet_manager.cc:1397] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.172s user 0.013s sys 0.004s
I20260807 13:40:33.977466 23888 raft_consensus.cc:348] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.978272 23888 raft_consensus.cc:374] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:33.977797 23881 raft_consensus.cc:348] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.978549 23888 raft_consensus.cc:729] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:33.979020 23881 raft_consensus.cc:374] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:33.979496 23881 raft_consensus.cc:729] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:33.979357 23888 consensus_queue.cc:260] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.980329 23449 catalog_manager.cc:5495] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 1 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:33.980284 23881 consensus_queue.cc:260] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:33.982563 23884 tablet_bootstrap.cc:654] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:33.990774 23888 ts_tablet_manager.cc:1428] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.017s user 0.007s sys 0.001s
I20260807 13:40:33.992901 23888 tablet_bootstrap.cc:492] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:34.000182 23888 tablet_bootstrap.cc:654] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:34.000478 23931 consensus_queue.cc:1035] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:40:34.011790 24178 raft_consensus.cc:482] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:34.025277 24178 raft_consensus.cc:504] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.026530 23703 raft_consensus.cc:3037] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:34.029142 24178 leader_election.cc:288] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:34.030283 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:34.035463 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:34.039693 23881 ts_tablet_manager.cc:1428] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.065s user 0.007s sys 0.000s
I20260807 13:40:34.040758 23660 leader_election.cc:302] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:34.050108 23881 tablet_bootstrap.cc:492] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:34.040699 24105 raft_consensus.cc:482] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:34.057678 24178 raft_consensus.cc:482] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:34.058439 24178 raft_consensus.cc:504] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.055521 24105 raft_consensus.cc:504] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.066594 24105 leader_election.cc:288] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:34.069037 24178 leader_election.cc:288] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:34.069852 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:34.069991 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:34.070668 23702 raft_consensus.cc:2454] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:34.070891 23597 raft_consensus.cc:2454] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:34.074110 23769 leader_election.cc:302] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:34.073963 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:34.075410 24063 raft_consensus.cc:2781] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:34.075269 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:34.076051 24063 raft_consensus.cc:482] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:34.075274 23599 raft_consensus.cc:2454] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:34.076460 24063 raft_consensus.cc:3037] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:34.077292 23662 leader_election.cc:302] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:34.078871 24178 raft_consensus.cc:2781] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:34.079295 24178 raft_consensus.cc:482] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:34.082890 24178 raft_consensus.cc:3037] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:34.085165 23888 tablet_bootstrap.cc:492] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:34.085645 23888 ts_tablet_manager.cc:1397] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.093s user 0.019s sys 0.009s
I20260807 13:40:34.087983 23707 raft_consensus.cc:1261] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260807 13:40:34.089143 23707 pending_rounds.cc:76] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37: Aborting all ops after (but not including) 0
I20260807 13:40:34.089346 23884 tablet_bootstrap.cc:492] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:34.090963 23884 ts_tablet_manager.cc:1397] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.147s user 0.014s sys 0.017s
I20260807 13:40:34.090886 23707 pending_rounds.cc:97] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260807 13:40:34.098372 23884 raft_consensus.cc:348] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.099954 23884 raft_consensus.cc:374] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:34.100256 23884 raft_consensus.cc:729] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:34.101691 23884 consensus_queue.cc:260] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.102330 23707 raft_consensus.cc:2866] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:40:34.103642 23884 ts_tablet_manager.cc:1428] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.012s user 0.003s sys 0.004s
I20260807 13:40:34.104993 23884 tablet_bootstrap.cc:492] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:34.105046 24105 consensus_queue.cc:1035] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:34.115732 23881 tablet_bootstrap.cc:654] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:34.116900 24178 raft_consensus.cc:504] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.120198 24090 raft_consensus.cc:2726] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:34.124596 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:34.125487 23597 raft_consensus.cc:3037] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:34.129753 24063 raft_consensus.cc:504] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.135396 23820 raft_consensus.cc:2379] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 1: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:34.136751 23888 raft_consensus.cc:348] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.137594 23888 raft_consensus.cc:374] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:34.137831 23888 raft_consensus.cc:729] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:34.138775 23888 consensus_queue.cc:260] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.140774 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:34.143873 23888 ts_tablet_manager.cc:1428] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.058s user 0.009s sys 0.000s
I20260807 13:40:34.130761 23599 raft_consensus.cc:1261] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260807 13:40:34.147281 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:34.147909 24063 leader_election.cc:288] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:34.148085 23597 raft_consensus.cc:2454] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:34.148370 23702 raft_consensus.cc:2379] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 1: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:34.148835 24063 consensus_queue.cc:1035] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:34.149591 23769 leader_election.cc:302] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:34.159169 24063 raft_consensus.cc:2726] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:40:34.151028 23662 leader_election.cc:302] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:34.160460 24090 raft_consensus.cc:2781] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:34.153724 23884 tablet_bootstrap.cc:654] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:34.161788 24090 raft_consensus.cc:686] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:34.166579 24090 consensus_queue.cc:237] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.192088 23888 tablet_bootstrap.cc:492] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:34.194751 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:34.197299 23820 raft_consensus.cc:2379] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 1: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:34.198848 24178 leader_election.cc:288] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:34.242960 23888 tablet_bootstrap.cc:654] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:34.243538 23884 tablet_bootstrap.cc:492] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:34.242050 23448 catalog_manager.cc:5495] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 1 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:34.244055 23884 ts_tablet_manager.cc:1397] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.139s user 0.020s sys 0.014s
I20260807 13:40:34.255251 23881 tablet_bootstrap.cc:492] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:34.255717 23881 ts_tablet_manager.cc:1397] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.210s user 0.030s sys 0.031s
I20260807 13:40:34.254160 23884 raft_consensus.cc:348] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.257139 23884 raft_consensus.cc:374] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:34.257452 23884 raft_consensus.cc:729] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:34.254125 24132 raft_consensus.cc:482] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:34.258085 23884 consensus_queue.cc:260] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.260916 23884 ts_tablet_manager.cc:1428] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.017s user 0.008s sys 0.000s
I20260807 13:40:34.263701 23884 tablet_bootstrap.cc:492] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:34.263283 23599 raft_consensus.cc:3037] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:34.258966 24132 raft_consensus.cc:504] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.266553 23881 raft_consensus.cc:348] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.272895 23881 raft_consensus.cc:374] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:34.273190 23881 raft_consensus.cc:729] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:34.277880 23881 consensus_queue.cc:260] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.287251 23881 ts_tablet_manager.cc:1428] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.031s user 0.003s sys 0.006s
I20260807 13:40:34.292168 23881 tablet_bootstrap.cc:492] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:34.293097 23703 raft_consensus.cc:3037] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:34.317953 23931 consensus_queue.cc:1035] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:40:34.321200 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:34.321578 23884 tablet_bootstrap.cc:654] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
W20260807 13:40:34.323808 23554 leader_election.cc:341] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:34.323567 24132 leader_election.cc:288] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:34.330230 23888 tablet_bootstrap.cc:492] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:34.330369 23881 tablet_bootstrap.cc:654] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:34.330824 23888 ts_tablet_manager.cc:1397] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.186s user 0.030s sys 0.017s
I20260807 13:40:34.337255 23888 raft_consensus.cc:348] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.339412 23888 raft_consensus.cc:374] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:34.339089 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:34.340065 23702 raft_consensus.cc:2454] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 0.
I20260807 13:40:34.340971 23888 raft_consensus.cc:729] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:34.341660 23888 consensus_queue.cc:260] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.343977 23888 ts_tablet_manager.cc:1428] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.013s user 0.007s sys 0.000s
I20260807 13:40:34.348639 23888 tablet_bootstrap.cc:492] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:34.367153 23970 raft_consensus.cc:482] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:34.367851 23970 raft_consensus.cc:504] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.371178 23555 leader_election.cc:302] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:34.372056 23970 leader_election.cc:288] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:34.373570 24122 raft_consensus.cc:2781] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:34.374212 24122 raft_consensus.cc:482] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:34.373976 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:34.374827 24122 raft_consensus.cc:3037] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:40:34.376760 23660 leader_election.cc:341] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:34.379335 23884 tablet_bootstrap.cc:492] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:34.379935 23884 ts_tablet_manager.cc:1397] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.117s user 0.009s sys 0.021s
I20260807 13:40:34.383882 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:34.404309 24132 raft_consensus.cc:482] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:34.405603 23881 tablet_bootstrap.cc:492] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:34.404953 24132 raft_consensus.cc:504] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.406102 23881 ts_tablet_manager.cc:1397] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.114s user 0.009s sys 0.014s
I20260807 13:40:34.396186 23601 raft_consensus.cc:2454] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:34.402676 24063 consensus_queue.cc:1035] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260807 13:40:34.413728 24132 leader_election.cc:288] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:34.418138 23931 raft_consensus.cc:482] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:34.418730 23931 raft_consensus.cc:504] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.420953 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:34.421835 23818 raft_consensus.cc:2454] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 0.
I20260807 13:40:34.422546 23931 leader_election.cc:288] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:34.426514 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:34.427454 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:34.428123 23554 leader_election.cc:302] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
W20260807 13:40:34.431339 23555 leader_election.cc:341] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:40:34.431531 23769 leader_election.cc:341] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:34.432968 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:34.433480 24132 raft_consensus.cc:2781] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:34.438308 24132 raft_consensus.cc:482] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:34.438918 24132 raft_consensus.cc:3037] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:34.439795 24122 raft_consensus.cc:504] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.441116 23662 leader_election.cc:302] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:34.437099 23888 tablet_bootstrap.cc:654] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:34.445647 23881 raft_consensus.cc:348] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.452684 23881 raft_consensus.cc:374] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:34.452991 23881 raft_consensus.cc:729] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:34.459312 23881 consensus_queue.cc:260] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.459349 23884 raft_consensus.cc:348] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.462049 23884 raft_consensus.cc:374] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:34.462391 23884 raft_consensus.cc:729] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:34.463204 23884 consensus_queue.cc:260] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.481225 23881 ts_tablet_manager.cc:1428] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.075s user 0.008s sys 0.000s
I20260807 13:40:34.468004 24176 raft_consensus.cc:2781] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:34.468510 24122 leader_election.cc:288] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:34.486910 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
W20260807 13:40:34.488394 23554 leader_election.cc:341] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:34.480738 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:34.489742 23711 raft_consensus.cc:3037] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:34.505051 23881 tablet_bootstrap.cc:492] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:34.486229 24176 raft_consensus.cc:482] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:34.511734 24176 raft_consensus.cc:3037] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:34.517913 23884 ts_tablet_manager.cc:1428] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.138s user 0.019s sys 0.012s
I20260807 13:40:34.514788 24090 raft_consensus.cc:482] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:34.535742 23884 tablet_bootstrap.cc:492] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:34.547652 23711 raft_consensus.cc:2454] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:34.535074 24090 raft_consensus.cc:504] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.567190 24090 leader_election.cc:288] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:34.531409 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 46026.4us
I20260807 13:40:34.603237 24132 raft_consensus.cc:504] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.605098 23601 raft_consensus.cc:2379] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 1: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:34.606339 23881 tablet_bootstrap.cc:654] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:34.647993 24132 leader_election.cc:288] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:34.651810 23555 leader_election.cc:302] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:34.655755 24132 raft_consensus.cc:2781] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:34.656934 24132 raft_consensus.cc:686] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:34.658023 24132 consensus_queue.cc:237] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.666615 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:34.668620 24063 raft_consensus.cc:482] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:34.669220 24063 raft_consensus.cc:504] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.672021 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:34.676090 24176 raft_consensus.cc:504] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.681201 23772 leader_election.cc:302] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:34.682869 23931 raft_consensus.cc:3037] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:34.685309 24063 leader_election.cc:288] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:34.686174 23884 tablet_bootstrap.cc:654] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
W20260807 13:40:34.695281 23555 leader_election.cc:341] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:34.696692 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:34.702535 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:34.707346 24176 leader_election.cc:288] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:34.692569 23662 leader_election.cc:341] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:34.709786 23888 tablet_bootstrap.cc:492] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:34.710685 23888 ts_tablet_manager.cc:1397] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.366s user 0.006s sys 0.021s
I20260807 13:40:34.709846 23931 raft_consensus.cc:2726] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 13:40:34.738162 23660 leader_election.cc:341] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:34.730286 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:34.734053 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:34.741947 23660 leader_election.cc:302] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
W20260807 13:40:34.751178 23660 leader_election.cc:341] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:34.733547 23820 raft_consensus.cc:3037] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:40:34.725586 23662 consensus_peers.cc:487] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 -> Peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Couldn't send request to peer 08757cfbeffb41bbab14c2ef00e9d812. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:40:34.748150 24176 raft_consensus.cc:2726] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:34.753473 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:34.753611 24314 consensus_queue.cc:1035] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260807 13:40:34.773250 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:34.774039 23601 raft_consensus.cc:3037] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:34.786599 23888 raft_consensus.cc:348] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.788182 23888 raft_consensus.cc:374] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:34.788475 23888 raft_consensus.cc:729] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:34.788640 23449 catalog_manager.cc:5495] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 0 to 1, leader changed from <none> to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 1 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:34.792865 23888 consensus_queue.cc:260] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.795874 23884 tablet_bootstrap.cc:492] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:34.796389 23884 ts_tablet_manager.cc:1397] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.261s user 0.018s sys 0.010s
I20260807 13:40:34.803009 23881 tablet_bootstrap.cc:492] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:34.803494 23881 ts_tablet_manager.cc:1397] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.320s user 0.016s sys 0.012s
I20260807 13:40:34.763420 24319 consensus_queue.cc:1035] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.047s
I20260807 13:40:34.790848 24318 consensus_queue.cc:1035] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.049s
I20260807 13:40:34.824527 23888 ts_tablet_manager.cc:1428] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.088s user 0.008s sys 0.000s
W20260807 13:40:34.826071 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 76638.5us
I20260807 13:40:34.820422 23601 raft_consensus.cc:2454] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:34.862051 23888 tablet_bootstrap.cc:492] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:34.869668 23884 raft_consensus.cc:348] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.870471 23884 raft_consensus.cc:374] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:34.870776 23884 raft_consensus.cc:729] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:34.873090 23884 consensus_queue.cc:260] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.879983 24328 raft_consensus.cc:482] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:40:34.883505 23535 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:40:34.880741 24328 raft_consensus.cc:504] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.887003 24328 leader_election.cc:288] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:34.862923 23823 raft_consensus.cc:2454] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:34.903105 23769 leader_election.cc:302] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:34.905581 23662 leader_election.cc:302] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:34.907629 24319 raft_consensus.cc:2781] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:34.908571 24319 raft_consensus.cc:686] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:34.909966 24319 consensus_queue.cc:237] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:34.932818 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 68893.5us
I20260807 13:40:34.952171 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:34.956415 23881 raft_consensus.cc:348] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.957746 23881 raft_consensus.cc:374] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:34.958050 23881 raft_consensus.cc:729] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:34.953086 23711 raft_consensus.cc:2454] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:34.958765 23881 consensus_queue.cc:260] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.967430 23881 ts_tablet_manager.cc:1428] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.164s user 0.010s sys 0.002s
I20260807 13:40:34.968544 23884 ts_tablet_manager.cc:1428] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.172s user 0.008s sys 0.003s
I20260807 13:40:34.952931 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:34.968365 23769 leader_election.cc:302] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:34.972704 23884 tablet_bootstrap.cc:492] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:34.976706 24316 raft_consensus.cc:482] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:34.977679 24316 raft_consensus.cc:504] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:34.981825 23888 tablet_bootstrap.cc:654] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:34.952906 23554 leader_election.cc:302] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
W20260807 13:40:34.989327 23772 leader_election.cc:341] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:34.975049 24214 raft_consensus.cc:2781] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:34.996907 23881 tablet_bootstrap.cc:492] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:35.000483 24308 raft_consensus.cc:2781] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:34.996120 24214 raft_consensus.cc:482] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:35.007486 24214 raft_consensus.cc:3037] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:35.051473 24316 leader_election.cc:288] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:35.016518 24308 raft_consensus.cc:686] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
W20260807 13:40:35.085042 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 51163.7us
I20260807 13:40:35.091475 24329 raft_consensus.cc:2726] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:35.094455 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:35.112574 23449 catalog_manager.cc:5495] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 1 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
W20260807 13:40:35.118985 23662 leader_election.cc:341] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:35.121945 23599 raft_consensus.cc:3037] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:35.107779 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:35.128214 24308 consensus_queue.cc:237] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:35.131371 24337 log.cc:924] Time spent T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.111s user 0.000s sys 0.001s
I20260807 13:40:35.141347 23881 tablet_bootstrap.cc:654] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:35.110821 24214 raft_consensus.cc:504] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:35.125615 24342 log.cc:924] Time spent T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.103s user 0.000s sys 0.001s
I20260807 13:40:35.202595 23825 raft_consensus.cc:2379] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 1: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:35.193209 23881 tablet_bootstrap.cc:492] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:35.203678 24214 leader_election.cc:288] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:35.194588 23888 tablet_bootstrap.cc:492] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:35.201676 23884 tablet_bootstrap.cc:654] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:35.204418 23888 ts_tablet_manager.cc:1397] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.343s user 0.021s sys 0.010s
I20260807 13:40:35.204017 23881 ts_tablet_manager.cc:1397] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.216s user 0.017s sys 0.013s
I20260807 13:40:35.208182 24344 consensus_queue.cc:1035] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260807 13:40:35.208488 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:35.215464 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:35.216284 23711 raft_consensus.cc:3037] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:35.221518 23881 raft_consensus.cc:348] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:35.222366 23881 raft_consensus.cc:374] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:35.210111 23888 raft_consensus.cc:348] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:35.222637 23881 raft_consensus.cc:729] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:35.226862 23881 consensus_queue.cc:260] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:35.224387 23772 leader_election.cc:341] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:35.223825 23888 raft_consensus.cc:374] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:35.229316 23888 raft_consensus.cc:729] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:35.230494 23660 leader_election.cc:302] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:35.233632 23888 consensus_queue.cc:260] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:35.236848 23888 ts_tablet_manager.cc:1428] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.032s user 0.006s sys 0.001s
I20260807 13:40:35.240325 23821 raft_consensus.cc:3037] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:35.241740 23888 tablet_bootstrap.cc:492] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:35.254354 23881 ts_tablet_manager.cc:1428] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.049s user 0.008s sys 0.000s
I20260807 13:40:35.258695 23881 tablet_bootstrap.cc:492] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:35.263180 23711 raft_consensus.cc:2454] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:35.267139 24318 raft_consensus.cc:2726] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:35.274788 23769 leader_election.cc:302] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:35.277222 24328 raft_consensus.cc:2781] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:35.281137 24328 raft_consensus.cc:686] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:35.285423 23884 tablet_bootstrap.cc:492] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:35.286156 23884 ts_tablet_manager.cc:1397] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.314s user 0.014s sys 0.018s
I20260807 13:40:35.284878 24328 consensus_queue.cc:237] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:35.293464 23884 raft_consensus.cc:348] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:35.294100 23884 raft_consensus.cc:374] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:35.294343 23884 raft_consensus.cc:729] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:35.295295 23881 tablet_bootstrap.cc:654] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:35.297034 23884 consensus_queue.cc:260] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:35.305040 23884 ts_tablet_manager.cc:1428] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.019s user 0.004s sys 0.002s
I20260807 13:40:35.306308 23884 tablet_bootstrap.cc:492] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:35.325659 23888 tablet_bootstrap.cc:654] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:35.332592 24308 consensus_queue.cc:1035] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260807 13:40:35.348562 24214 raft_consensus.cc:482] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:35.354694 23884 tablet_bootstrap.cc:654] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:35.349292 24214 raft_consensus.cc:504] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:35.357775 23881 tablet_bootstrap.cc:492] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:35.367095 23881 ts_tablet_manager.cc:1397] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.109s user 0.015s sys 0.009s
I20260807 13:40:35.371027 23881 raft_consensus.cc:348] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:35.371812 23881 raft_consensus.cc:374] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:35.372131 23881 raft_consensus.cc:729] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:35.371872 23450 catalog_manager.cc:5495] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 0 to 1, leader changed from <none> to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 1 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:35.372844 23881 consensus_queue.cc:260] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:35.375285 23881 ts_tablet_manager.cc:1428] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.008s user 0.006s sys 0.001s
I20260807 13:40:35.377264 23881 tablet_bootstrap.cc:492] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:35.391408 24214 leader_election.cc:288] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:35.412014 24329 raft_consensus.cc:482] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:35.412643 24329 raft_consensus.cc:504] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:35.415866 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:35.417184 23594 raft_consensus.cc:2379] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 1: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:35.420217 24329 leader_election.cc:288] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:35.413473 23448 catalog_manager.cc:5495] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 0 to 1, leader changed from <none> to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 1 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:35.423741 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:35.440234 24319 consensus_queue.cc:1035] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:35.422876 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:35.478511 24122 raft_consensus.cc:482] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:35.479499 24122 raft_consensus.cc:504] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:35.482234 24122 leader_election.cc:288] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:35.485265 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:35.486176 23707 raft_consensus.cc:2454] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 0.
I20260807 13:40:35.489759 23884 tablet_bootstrap.cc:492] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:35.490288 23884 ts_tablet_manager.cc:1397] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.184s user 0.025s sys 0.021s
I20260807 13:40:35.491552 23555 leader_election.cc:302] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:35.494903 24344 raft_consensus.cc:2781] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:35.501914 24344 raft_consensus.cc:482] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:35.502401 24344 raft_consensus.cc:3037] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:35.497710 23772 leader_election.cc:302] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:35.505249 23818 raft_consensus.cc:3037] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:35.501443 23884 raft_consensus.cc:348] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:35.508845 23884 raft_consensus.cc:374] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:35.509276 23884 raft_consensus.cc:729] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:35.518797 23888 tablet_bootstrap.cc:492] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:35.519403 23888 ts_tablet_manager.cc:1397] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.282s user 0.015s sys 0.024s
I20260807 13:40:35.521175 23884 consensus_queue.cc:260] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:35.503643 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:35.499610 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:35.546854 23888 raft_consensus.cc:348] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:35.547793 23888 raft_consensus.cc:374] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:35.548132 23888 raft_consensus.cc:729] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
W20260807 13:40:35.551298 23554 leader_election.cc:341] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:35.552153 23888 consensus_queue.cc:260] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:35.551810 24344 raft_consensus.cc:504] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:35.559149 23884 ts_tablet_manager.cc:1428] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.069s user 0.010s sys 0.005s
I20260807 13:40:35.560781 23772 leader_election.cc:302] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:35.563886 23881 tablet_bootstrap.cc:654] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:35.570356 23888 ts_tablet_manager.cc:1428] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.051s user 0.009s sys 0.001s
I20260807 13:40:35.567464 24214 raft_consensus.cc:2726] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:35.574977 23702 raft_consensus.cc:3037] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:35.580724 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:35.581588 23711 raft_consensus.cc:3037] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:35.586843 23884 tablet_bootstrap.cc:492] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:35.605965 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
W20260807 13:40:35.610469 23554 leader_election.cc:341] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:35.601437 24344 leader_election.cc:288] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:35.623896 24329 raft_consensus.cc:2726] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:35.644605 24090 raft_consensus.cc:482] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:35.653872 24090 raft_consensus.cc:504] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:35.622885 24344 consensus_queue.cc:1035] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260807 13:40:35.658541 24344 consensus_queue.cc:1035] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:35.659945 24178 consensus_queue.cc:1035] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:35.666184 23884 tablet_bootstrap.cc:654] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:35.669334 23821 raft_consensus.cc:3037] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:35.675211 24344 raft_consensus.cc:482] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:35.675897 24344 raft_consensus.cc:504] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:35.689734 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:35.690016 23711 raft_consensus.cc:2454] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
W20260807 13:40:35.691421 23555 leader_election.cc:341] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:35.692756 23555 leader_election.cc:302] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:35.693666 24374 raft_consensus.cc:2781] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:35.694516 24374 raft_consensus.cc:686] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:35.694790 24344 leader_election.cc:288] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:35.696091 24374 consensus_queue.cc:237] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:35.699946 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:35.701903 23881 tablet_bootstrap.cc:492] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:35.704533 23881 ts_tablet_manager.cc:1397] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.328s user 0.014s sys 0.011s
I20260807 13:40:35.708094 23881 raft_consensus.cc:348] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:35.708356 23554 leader_election.cc:341] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:35.708806 23881 raft_consensus.cc:374] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:35.709139 23554 leader_election.cc:302] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:35.709142 23881 raft_consensus.cc:729] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:35.710958 24344 raft_consensus.cc:2726] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:35.710980 23881 consensus_queue.cc:260] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:35.718201 23888 tablet_bootstrap.cc:492] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:35.718261 24090 leader_election.cc:288] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:35.723033 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:35.757654 23881 ts_tablet_manager.cc:1428] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.053s user 0.008s sys 0.000s
I20260807 13:40:35.790827 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:35.801452 23884 tablet_bootstrap.cc:492] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:35.802429 23884 ts_tablet_manager.cc:1397] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.232s user 0.012s sys 0.043s
I20260807 13:40:35.808041 23881 tablet_bootstrap.cc:492] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:35.815958 23660 leader_election.cc:302] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:35.820277 24319 raft_consensus.cc:2726] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:35.825783 23884 raft_consensus.cc:348] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:35.833600 23450 catalog_manager.cc:5495] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 0 to 1, leader changed from <none> to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 1 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:35.826555 23884 raft_consensus.cc:374] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:35.837805 23884 raft_consensus.cc:729] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:35.839102 23884 consensus_queue.cc:260] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:35.853801 23772 consensus_peers.cc:487] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 -> Peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Couldn't send request to peer 08757cfbeffb41bbab14c2ef00e9d812. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:40:35.856937 23888 tablet_bootstrap.cc:654] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:35.869092 24318 raft_consensus.cc:482] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:35.869967 24318 raft_consensus.cc:504] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:35.872632 24318 leader_election.cc:288] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:35.875136 23884 ts_tablet_manager.cc:1428] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.072s user 0.010s sys 0.000s
I20260807 13:40:35.877229 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:35.879024 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:35.881597 23662 leader_election.cc:341] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:40:35.886284 23660 leader_election.cc:341] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:35.886776 23660 leader_election.cc:302] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:35.888098 24176 raft_consensus.cc:2726] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:35.917763 23881 tablet_bootstrap.cc:654] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:35.916198 24328 consensus_queue.cc:1035] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260807 13:40:35.922395 23884 tablet_bootstrap.cc:492] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:35.927430 23888 tablet_bootstrap.cc:492] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:35.937201 23888 ts_tablet_manager.cc:1397] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.219s user 0.035s sys 0.025s
I20260807 13:40:35.953076 23888 raft_consensus.cc:348] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:35.954187 23888 raft_consensus.cc:374] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:35.954622 23888 raft_consensus.cc:729] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:35.955744 23888 consensus_queue.cc:260] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:35.970124 23884 tablet_bootstrap.cc:654] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:35.970798 23888 ts_tablet_manager.cc:1428] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.026s user 0.001s sys 0.007s
I20260807 13:40:35.972013 23888 tablet_bootstrap.cc:492] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
W20260807 13:40:36.004943 23535 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:40:36.009994 23881 tablet_bootstrap.cc:492] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:36.010744 23881 ts_tablet_manager.cc:1397] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.203s user 0.017s sys 0.018s
I20260807 13:40:36.011013 23888 tablet_bootstrap.cc:654] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:36.016484 23881 raft_consensus.cc:348] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.017520 23881 raft_consensus.cc:374] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:36.017807 23881 raft_consensus.cc:729] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:36.022776 23881 consensus_queue.cc:260] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.025969 23881 ts_tablet_manager.cc:1428] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.015s user 0.006s sys 0.001s
I20260807 13:40:36.029219 24373 raft_consensus.cc:482] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:36.029925 24373 raft_consensus.cc:504] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.032873 24373 leader_election.cc:288] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:36.034507 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:36.035113 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:36.035251 23598 raft_consensus.cc:2454] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:36.033824 23884 tablet_bootstrap.cc:492] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:36.036538 23884 ts_tablet_manager.cc:1397] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.114s user 0.019s sys 0.011s
W20260807 13:40:36.037631 23769 leader_election.cc:341] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:36.038803 23772 leader_election.cc:302] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:36.039052 23884 raft_consensus.cc:348] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.039716 23884 raft_consensus.cc:374] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:36.039987 23884 raft_consensus.cc:729] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:36.040328 24328 raft_consensus.cc:2781] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:36.040700 24328 raft_consensus.cc:482] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:36.041131 24328 raft_consensus.cc:3037] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:36.040721 23884 consensus_queue.cc:260] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.043757 23884 ts_tablet_manager.cc:1428] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20260807 13:40:36.044756 23884 tablet_bootstrap.cc:492] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:36.055513 23881 tablet_bootstrap.cc:492] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:36.060735 24328 raft_consensus.cc:504] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.064410 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:36.065056 23598 raft_consensus.cc:3037] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:36.073307 23598 raft_consensus.cc:2454] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:36.076496 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:36.076629 23772 leader_election.cc:302] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
W20260807 13:40:36.077800 23769 leader_election.cc:341] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:36.078418 24373 raft_consensus.cc:2781] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:36.079140 24373 raft_consensus.cc:686] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:36.080005 24373 consensus_queue.cc:237] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.080889 23888 tablet_bootstrap.cc:492] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:36.081359 23888 ts_tablet_manager.cc:1397] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.110s user 0.019s sys 0.033s
I20260807 13:40:36.085352 23888 raft_consensus.cc:348] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.096935 23888 raft_consensus.cc:374] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:36.097237 23888 raft_consensus.cc:729] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:36.082047 24328 leader_election.cc:288] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:36.098435 23888 consensus_queue.cc:260] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.105187 23881 tablet_bootstrap.cc:654] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:36.106348 23888 ts_tablet_manager.cc:1428] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.025s user 0.008s sys 0.000s
I20260807 13:40:36.107421 23888 tablet_bootstrap.cc:492] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:36.114106 23888 tablet_bootstrap.cc:654] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:36.123415 23450 catalog_manager.cc:5495] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 0 to 1, leader changed from <none> to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 1 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:36.125809 23888 tablet_bootstrap.cc:492] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:36.126348 23888 ts_tablet_manager.cc:1397] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.019s user 0.011s sys 0.005s
I20260807 13:40:36.129354 23888 raft_consensus.cc:348] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.130123 23888 raft_consensus.cc:374] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:36.130422 23888 raft_consensus.cc:729] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:36.131166 23888 consensus_queue.cc:260] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.132592 23884 tablet_bootstrap.cc:654] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:36.133116 24328 raft_consensus.cc:482] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:36.133739 23888 ts_tablet_manager.cc:1428] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260807 13:40:36.134835 23888 tablet_bootstrap.cc:492] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:36.133631 24328 raft_consensus.cc:504] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.137195 24328 leader_election.cc:288] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:36.137835 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:36.139254 23772 leader_election.cc:341] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:36.139195 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:36.141621 23769 leader_election.cc:341] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:36.142036 23769 leader_election.cc:302] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:36.143625 23881 tablet_bootstrap.cc:492] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:36.143520 24328 raft_consensus.cc:2726] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:36.144598 23881 ts_tablet_manager.cc:1397] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.089s user 0.008s sys 0.007s
I20260807 13:40:36.145587 24313 raft_consensus.cc:482] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:36.146051 24313 raft_consensus.cc:504] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.147538 23881 raft_consensus.cc:348] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.148232 23881 raft_consensus.cc:374] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:36.148502 23881 raft_consensus.cc:729] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:36.149191 23881 consensus_queue.cc:260] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.150218 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:36.151438 23881 ts_tablet_manager.cc:1428] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260807 13:40:36.152249 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:36.151146 24313 leader_election.cc:288] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:36.152381 23662 leader_election.cc:341] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:36.152549 23881 tablet_bootstrap.cc:492] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
W20260807 13:40:36.153622 23660 leader_election.cc:341] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:36.154031 23660 leader_election.cc:302] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:36.155244 24313 raft_consensus.cc:2726] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:36.150565 23888 tablet_bootstrap.cc:654] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:36.171855 23881 tablet_bootstrap.cc:654] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
W20260807 13:40:36.178957 23554 consensus_peers.cc:487] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 -> Peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Couldn't send request to peer d28e736aee9f4f01b013de670a762697. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:40:36.180939 23884 tablet_bootstrap.cc:492] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:36.181680 23884 ts_tablet_manager.cc:1397] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.137s user 0.010s sys 0.012s
I20260807 13:40:36.187520 23888 tablet_bootstrap.cc:492] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:36.188045 23888 ts_tablet_manager.cc:1397] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.053s user 0.013s sys 0.013s
I20260807 13:40:36.190420 23888 raft_consensus.cc:348] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.191116 23888 raft_consensus.cc:374] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:36.191366 23888 raft_consensus.cc:729] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:36.194783 23884 raft_consensus.cc:348] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.196000 23884 raft_consensus.cc:374] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:36.196422 23884 raft_consensus.cc:729] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:36.197592 24374 consensus_queue.cc:1035] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:40:36.197125 23884 consensus_queue.cc:260] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.200676 23884 ts_tablet_manager.cc:1428] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.019s user 0.006s sys 0.000s
I20260807 13:40:36.202221 23884 tablet_bootstrap.cc:492] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:36.212430 23884 tablet_bootstrap.cc:654] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:36.213024 23888 consensus_queue.cc:260] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.216360 23888 ts_tablet_manager.cc:1428] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.028s user 0.005s sys 0.001s
I20260807 13:40:36.223438 23888 tablet_bootstrap.cc:492] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:36.225716 23881 tablet_bootstrap.cc:492] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:36.226240 23881 ts_tablet_manager.cc:1397] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.074s user 0.011s sys 0.025s
I20260807 13:40:36.241744 23888 tablet_bootstrap.cc:654] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:36.244415 23881 raft_consensus.cc:348] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.245311 23881 raft_consensus.cc:374] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:36.245602 23881 raft_consensus.cc:729] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:36.247304 23888 tablet_bootstrap.cc:492] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:36.247833 23888 ts_tablet_manager.cc:1397] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.025s user 0.011s sys 0.001s
I20260807 13:40:36.248778 23884 tablet_bootstrap.cc:492] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:36.249271 23884 ts_tablet_manager.cc:1397] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.047s user 0.015s sys 0.000s
I20260807 13:40:36.250497 23888 raft_consensus.cc:348] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.246237 23881 consensus_queue.cc:260] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.251638 23884 raft_consensus.cc:348] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.252346 23884 raft_consensus.cc:374] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:36.252610 23884 raft_consensus.cc:729] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:36.252638 23888 raft_consensus.cc:374] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:36.254609 23888 raft_consensus.cc:729] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:36.254321 23881 ts_tablet_manager.cc:1428] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.028s user 0.004s sys 0.004s
I20260807 13:40:36.257066 23881 tablet_bootstrap.cc:492] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:36.255384 23888 consensus_queue.cc:260] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.260402 24090 raft_consensus.cc:482] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:36.260872 24090 raft_consensus.cc:504] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.263248 24090 leader_election.cc:288] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:36.260089 23888 ts_tablet_manager.cc:1428] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.012s user 0.005s sys 0.000s
I20260807 13:40:36.264727 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:36.266784 23660 leader_election.cc:341] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:36.271572 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:36.272318 23594 raft_consensus.cc:2454] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:36.275616 23881 tablet_bootstrap.cc:654] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:36.278029 23662 leader_election.cc:302] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:36.280192 24090 raft_consensus.cc:2781] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:36.280645 24090 raft_consensus.cc:482] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:36.280979 24090 raft_consensus.cc:3037] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:36.284459 23888 tablet_bootstrap.cc:492] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:36.294162 23888 tablet_bootstrap.cc:654] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:36.295872 23884 consensus_queue.cc:260] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.297243 24313 raft_consensus.cc:482] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:36.297591 23884 ts_tablet_manager.cc:1428] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.048s user 0.006s sys 0.000s
I20260807 13:40:36.297698 24313 raft_consensus.cc:504] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.299708 24313 leader_election.cc:288] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:36.301321 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:36.302737 23881 tablet_bootstrap.cc:492] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
W20260807 13:40:36.303130 23660 leader_election.cc:341] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:36.304323 23881 ts_tablet_manager.cc:1397] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.048s user 0.009s sys 0.003s
I20260807 13:40:36.304450 23884 tablet_bootstrap.cc:492] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:36.307605 23881 raft_consensus.cc:348] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.309496 23881 raft_consensus.cc:374] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:36.310808 23881 raft_consensus.cc:729] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:36.311612 23881 consensus_queue.cc:260] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.316486 23881 ts_tablet_manager.cc:1428] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.012s user 0.005s sys 0.000s
I20260807 13:40:36.314399 23888 tablet_bootstrap.cc:492] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:36.317163 23888 ts_tablet_manager.cc:1397] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.033s user 0.013s sys 0.000s
I20260807 13:40:36.320418 24373 raft_consensus.cc:482] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:36.313143 23884 tablet_bootstrap.cc:654] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:36.320914 24373 raft_consensus.cc:504] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.322952 24373 leader_election.cc:288] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:36.320195 23888 raft_consensus.cc:348] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.323614 23888 raft_consensus.cc:374] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:36.323984 23888 raft_consensus.cc:729] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:36.324767 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:36.325711 23888 consensus_queue.cc:260] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.327656 23881 tablet_bootstrap.cc:492] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
W20260807 13:40:36.328599 23769 leader_election.cc:341] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:36.330190 23888 ts_tablet_manager.cc:1428] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.013s user 0.006s sys 0.000s
I20260807 13:40:36.332084 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:36.337662 23888 tablet_bootstrap.cc:492] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
W20260807 13:40:36.337863 23772 leader_election.cc:341] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:36.338557 23772 leader_election.cc:302] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:36.339390 24063 raft_consensus.cc:2726] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:36.340633 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:36.342887 24090 raft_consensus.cc:504] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:36.347632 23662 leader_election.cc:341] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:36.348104 24090 leader_election.cc:288] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:36.336485 23881 tablet_bootstrap.cc:654] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:36.349640 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:36.350291 23821 raft_consensus.cc:3037] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:36.353819 23888 tablet_bootstrap.cc:654] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:36.348068 23662 leader_election.cc:302] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:36.357733 24122 raft_consensus.cc:482] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:36.388214 24090 raft_consensus.cc:2726] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:36.388568 24122 raft_consensus.cc:504] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.358593 24378 raft_consensus.cc:482] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:36.365918 24344 raft_consensus.cc:482] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:36.390089 23821 raft_consensus.cc:2454] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:36.399973 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:36.401095 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:36.379285 23881 tablet_bootstrap.cc:492] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:36.395416 24122 leader_election.cc:288] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:36.401172 23711 raft_consensus.cc:2454] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 0.
I20260807 13:40:36.402602 23881 ts_tablet_manager.cc:1397] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.075s user 0.013s sys 0.010s
I20260807 13:40:36.392653 24344 raft_consensus.cc:504] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.406365 23660 leader_election.cc:302] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
W20260807 13:40:36.407392 23554 leader_election.cc:341] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:36.408677 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:36.409452 23594 raft_consensus.cc:3037] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:36.409792 23884 tablet_bootstrap.cc:492] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:36.410422 23884 ts_tablet_manager.cc:1397] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.106s user 0.008s sys 0.015s
I20260807 13:40:36.391582 24378 raft_consensus.cc:504] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.409650 24344 leader_election.cc:288] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:36.414031 23555 leader_election.cc:302] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:36.412330 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:36.415308 23821 raft_consensus.cc:2454] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 0.
I20260807 13:40:36.415668 24395 raft_consensus.cc:2781] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:36.415944 24378 leader_election.cc:288] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:36.416328 24395 raft_consensus.cc:686] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:36.416627 24378 raft_consensus.cc:2781] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:36.419267 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:36.419973 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:36.422324 23555 leader_election.cc:341] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:36.422802 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:36.423125 24395 consensus_queue.cc:237] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:36.424638 23555 leader_election.cc:341] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:36.427060 23591 raft_consensus.cc:3037] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:36.431281 23554 leader_election.cc:302] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:36.436523 24374 raft_consensus.cc:2781] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:36.436892 24374 raft_consensus.cc:482] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:36.437251 24374 raft_consensus.cc:3037] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:36.437064 23884 raft_consensus.cc:348] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.437800 23884 raft_consensus.cc:374] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:36.438086 23884 raft_consensus.cc:729] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:36.417034 24378 raft_consensus.cc:482] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:36.440233 23881 raft_consensus.cc:348] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.441098 23881 raft_consensus.cc:374] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:36.438620 24378 raft_consensus.cc:3037] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:36.441514 23881 raft_consensus.cc:729] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:36.442219 23881 consensus_queue.cc:260] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.438755 23884 consensus_queue.cc:260] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.445358 23884 ts_tablet_manager.cc:1428] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.035s user 0.005s sys 0.005s
I20260807 13:40:36.448087 23884 tablet_bootstrap.cc:492] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:36.447093 23881 ts_tablet_manager.cc:1428] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.042s user 0.007s sys 0.000s
W20260807 13:40:36.453712 23554 leader_election.cc:341] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:36.454241 23554 leader_election.cc:302] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:36.455638 24374 raft_consensus.cc:504] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.458753 23881 tablet_bootstrap.cc:492] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:36.474931 23888 tablet_bootstrap.cc:492] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:36.463021 24418 raft_consensus.cc:2726] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:36.475462 23888 ts_tablet_manager.cc:1397] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.138s user 0.014s sys 0.006s
I20260807 13:40:36.478493 24395 raft_consensus.cc:482] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:36.476752 23448 catalog_manager.cc:5495] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 1 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:36.485476 23888 raft_consensus.cc:348] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.492266 23888 raft_consensus.cc:374] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:36.492668 23888 raft_consensus.cc:729] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:36.493340 23888 consensus_queue.cc:260] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.493228 24395 raft_consensus.cc:504] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.495854 23888 ts_tablet_manager.cc:1428] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.020s user 0.003s sys 0.006s
I20260807 13:40:36.496640 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:36.499442 24374 leader_election.cc:288] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:36.502285 23884 tablet_bootstrap.cc:654] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:36.504036 24418 raft_consensus.cc:482] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:40:36.508967 23555 leader_election.cc:341] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:36.512257 23888 tablet_bootstrap.cc:492] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:36.522176 23881 tablet_bootstrap.cc:654] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:36.511325 24418 raft_consensus.cc:504] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.533499 24418 leader_election.cc:288] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:36.534212 24090 raft_consensus.cc:482] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:36.535147 23594 raft_consensus.cc:2454] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:36.534904 24090 raft_consensus.cc:504] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.535487 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:36.536098 23821 raft_consensus.cc:3037] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:36.538201 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:36.538861 23711 raft_consensus.cc:2454] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 0.
I20260807 13:40:36.539619 24090 leader_election.cc:288] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:36.540149 23555 leader_election.cc:302] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:36.542675 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:36.544046 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:36.540098 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:36.547524 23594 raft_consensus.cc:2379] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 1: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
W20260807 13:40:36.548059 23554 leader_election.cc:341] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:36.544718 24418 raft_consensus.cc:2781] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:36.550488 24418 raft_consensus.cc:482] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:36.551546 24418 raft_consensus.cc:3037] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:36.550112 24378 raft_consensus.cc:504] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.555022 23821 raft_consensus.cc:2454] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:36.556710 23888 tablet_bootstrap.cc:654] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:36.556924 23660 leader_election.cc:302] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:36.561239 24313 raft_consensus.cc:3037] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:36.563318 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:36.563933 23711 raft_consensus.cc:3037] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:36.562279 24374 raft_consensus.cc:482] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:36.567137 24374 raft_consensus.cc:504] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.569020 24374 leader_election.cc:288] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:36.571434 23881 tablet_bootstrap.cc:492] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:36.572001 23881 ts_tablet_manager.cc:1397] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.113s user 0.011s sys 0.007s
I20260807 13:40:36.579876 24063 raft_consensus.cc:482] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:36.580350 24063 raft_consensus.cc:504] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.572647 24373 raft_consensus.cc:482] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:36.577592 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:36.588224 24063 leader_election.cc:288] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:36.599588 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:36.602538 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:36.603246 23704 raft_consensus.cc:2454] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:36.603579 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:36.589958 24373 raft_consensus.cc:504] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.609382 24373 leader_election.cc:288] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:40:36.600979 23660 leader_election.cc:341] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:36.611545 23881 raft_consensus.cc:348] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.612247 23881 raft_consensus.cc:374] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:36.612520 23881 raft_consensus.cc:729] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:36.613384 23881 consensus_queue.cc:260] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:36.615640 23772 leader_election.cc:341] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:36.591228 24378 leader_election.cc:288] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:36.621443 23769 leader_election.cc:302] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:36.622385 24063 raft_consensus.cc:2781] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260807 13:40:36.622694 23555 leader_election.cc:341] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:36.622809 24063 raft_consensus.cc:482] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:36.623189 24063 raft_consensus.cc:3037] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:36.593703 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:36.623915 23711 raft_consensus.cc:2454] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:36.595824 24395 leader_election.cc:288] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:36.580200 23554 leader_election.cc:302] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:36.625162 23881 ts_tablet_manager.cc:1428] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.051s user 0.006s sys 0.000s
I20260807 13:40:36.637341 23555 leader_election.cc:302] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:36.642791 23881 tablet_bootstrap.cc:492] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:36.646390 23884 tablet_bootstrap.cc:492] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:36.646857 23884 ts_tablet_manager.cc:1397] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.199s user 0.011s sys 0.012s
I20260807 13:40:36.626791 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:36.641067 24378 raft_consensus.cc:2781] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:36.654819 24378 raft_consensus.cc:686] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:36.654976 24328 consensus_queue.cc:1035] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:36.655778 24378 consensus_queue.cc:237] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.641903 24344 raft_consensus.cc:2781] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:36.660193 24344 raft_consensus.cc:686] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:36.642434 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:36.664961 23888 tablet_bootstrap.cc:492] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:36.665611 23888 ts_tablet_manager.cc:1397] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.154s user 0.025s sys 0.033s
W20260807 13:40:36.651240 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 77635.9us
I20260807 13:40:36.661806 24344 consensus_queue.cc:237] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.713289 24313 raft_consensus.cc:2726] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:36.735852 23888 raft_consensus.cc:348] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.736650 23888 raft_consensus.cc:374] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:36.736904 23888 raft_consensus.cc:729] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:36.737999 23888 consensus_queue.cc:260] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.750447 24063 raft_consensus.cc:504] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.753805 24063 leader_election.cc:288] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:36.755324 23888 ts_tablet_manager.cc:1428] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.089s user 0.014s sys 0.010s
I20260807 13:40:36.765702 23888 tablet_bootstrap.cc:492] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:36.765506 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:36.766410 23823 raft_consensus.cc:3037] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:36.779356 23823 raft_consensus.cc:2454] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:36.780682 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:36.783428 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:36.784478 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:36.788079 24063 consensus_queue.cc:1035] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:36.798278 23881 tablet_bootstrap.cc:654] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:36.795761 23884 raft_consensus.cc:348] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.801595 23884 raft_consensus.cc:374] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:36.802078 23884 raft_consensus.cc:729] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:36.803223 23884 consensus_queue.cc:260] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.796926 23704 raft_consensus.cc:3037] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:36.819084 23884 ts_tablet_manager.cc:1428] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.172s user 0.016s sys 0.024s
I20260807 13:40:36.820835 23888 tablet_bootstrap.cc:654] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:36.832587 24418 raft_consensus.cc:504] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:36.837798 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 49429.8us
I20260807 13:40:36.843876 23448 catalog_manager.cc:5495] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 0 to 1, leader changed from <none> to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 1 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:36.854403 23884 tablet_bootstrap.cc:492] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:36.834602 24418 leader_election.cc:288] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:36.856475 23772 leader_election.cc:302] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
W20260807 13:40:36.861423 23772 leader_election.cc:341] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:36.867704 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:36.857051 23591 raft_consensus.cc:2379] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 1: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:36.868379 23700 raft_consensus.cc:3037] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:36.861836 24373 raft_consensus.cc:2726] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:36.875697 23825 raft_consensus.cc:3037] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:40:36.879768 23554 leader_election.cc:341] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:36.880306 23881 tablet_bootstrap.cc:492] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:36.880254 23554 leader_election.cc:302] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:36.880798 23881 ts_tablet_manager.cc:1397] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.239s user 0.011s sys 0.010s
I20260807 13:40:36.881045 24344 raft_consensus.cc:2726] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:36.884574 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
W20260807 13:40:36.901809 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 55015.1us
I20260807 13:40:36.949689 23662 leader_election.cc:302] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:36.935642 24313 consensus_queue.cc:1035] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260807 13:40:36.977161 23888 tablet_bootstrap.cc:492] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:36.977741 23888 ts_tablet_manager.cc:1397] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.217s user 0.013s sys 0.023s
I20260807 13:40:36.985877 23881 raft_consensus.cc:348] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.987169 23881 raft_consensus.cc:374] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:36.987444 23881 raft_consensus.cc:729] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:36.994643 23881 consensus_queue.cc:260] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:36.980435 24374 raft_consensus.cc:482] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:37.000765 24374 raft_consensus.cc:504] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:37.002297 23881 ts_tablet_manager.cc:1428] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.121s user 0.009s sys 0.000s
I20260807 13:40:37.003530 23881 tablet_bootstrap.cc:492] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
W20260807 13:40:37.021198 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 45447.7us
W20260807 13:40:37.026798 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 59782.1us
I20260807 13:40:37.030718 23447 catalog_manager.cc:5495] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 0 to 1, leader changed from <none> to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 1 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
W20260807 13:40:37.000773 23554 leader_election.cc:341] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:37.036180 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:37.036904 23820 raft_consensus.cc:2454] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 0.
I20260807 13:40:37.020799 24374 leader_election.cc:288] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:37.059775 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:37.062425 23707 raft_consensus.cc:2454] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 0.
I20260807 13:40:37.085893 23881 tablet_bootstrap.cc:654] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:37.044525 23554 leader_election.cc:302] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:37.067440 24441 consensus_queue.cc:1035] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260807 13:40:37.115934 24344 raft_consensus.cc:2781] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:37.131098 23704 raft_consensus.cc:2454] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:37.131381 24344 raft_consensus.cc:482] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:37.132102 24344 raft_consensus.cc:3037] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:40:37.110847 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 70041.4us
I20260807 13:40:37.120293 23700 raft_consensus.cc:2454] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:37.141276 24090 raft_consensus.cc:2726] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:37.143575 23888 raft_consensus.cc:348] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:37.144296 23888 raft_consensus.cc:374] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:37.144703 23888 raft_consensus.cc:729] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:37.143028 24445 raft_consensus.cc:482] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:37.145473 24445 raft_consensus.cc:504] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:37.145479 23888 consensus_queue.cc:260] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:37.152274 23884 tablet_bootstrap.cc:654] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:37.149125 23888 ts_tablet_manager.cc:1428] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.171s user 0.009s sys 0.003s
W20260807 13:40:37.155671 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 112706us
I20260807 13:40:37.158555 24445 leader_election.cc:288] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:37.154908 23769 leader_election.cc:302] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:37.160379 24063 raft_consensus.cc:2781] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:37.160830 24063 raft_consensus.cc:686] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:37.161549 24063 consensus_queue.cc:237] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:37.167376 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:37.168546 23703 raft_consensus.cc:2379] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 1: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:37.181054 23888 tablet_bootstrap.cc:492] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
W20260807 13:40:37.196871 23535 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:40:37.235386 24418 consensus_queue.cc:1035] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:37.239220 23555 leader_election.cc:302] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:37.241916 23884 tablet_bootstrap.cc:492] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:37.242357 23884 ts_tablet_manager.cc:1397] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.415s user 0.018s sys 0.021s
W20260807 13:40:37.254220 23555 consensus_peers.cc:487] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 -> Peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Couldn't send request to peer 8a3af1d071e74f2eb0c821e2bd68fe37. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:40:37.245672 24374 raft_consensus.cc:2781] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:37.261615 24374 raft_consensus.cc:686] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:37.262610 23884 raft_consensus.cc:348] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:37.263494 23884 raft_consensus.cc:374] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:37.262929 24374 consensus_queue.cc:237] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:37.263772 23884 raft_consensus.cc:729] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:37.264519 23884 consensus_queue.cc:260] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:37.269410 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:37.275225 24122 consensus_queue.cc:1035] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:37.287352 23884 ts_tablet_manager.cc:1428] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.045s user 0.008s sys 0.000s
I20260807 13:40:37.287878 23881 tablet_bootstrap.cc:492] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:37.288620 23881 ts_tablet_manager.cc:1397] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.285s user 0.021s sys 0.041s
I20260807 13:40:37.298348 23772 leader_election.cc:302] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:37.305174 23888 tablet_bootstrap.cc:654] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:37.310690 24428 raft_consensus.cc:3037] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:37.327580 23884 tablet_bootstrap.cc:492] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:37.327117 24122 raft_consensus.cc:482] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:37.335227 24122 raft_consensus.cc:504] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:37.337410 23881 raft_consensus.cc:348] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:37.338614 23881 raft_consensus.cc:374] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:37.338994 23881 raft_consensus.cc:729] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:37.339660 23881 consensus_queue.cc:260] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:37.334214 24378 consensus_queue.cc:1035] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260807 13:40:37.332477 24344 raft_consensus.cc:504] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:37.354897 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:37.356062 23710 raft_consensus.cc:2454] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 0.
I20260807 13:40:37.338356 24122 leader_election.cc:288] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:37.359800 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:37.364471 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:37.361253 24344 leader_election.cc:288] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:37.367007 23823 raft_consensus.cc:3037] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:37.367841 23881 ts_tablet_manager.cc:1428] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.079s user 0.005s sys 0.005s
I20260807 13:40:37.369356 23881 tablet_bootstrap.cc:492] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:37.369429 23821 raft_consensus.cc:2454] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 0.
I20260807 13:40:37.373366 23555 leader_election.cc:302] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:37.374521 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:37.389551 23704 raft_consensus.cc:3037] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:37.373304 23447 catalog_manager.cc:5495] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 0 to 1, leader changed from <none> to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 1 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:37.403079 24344 raft_consensus.cc:2781] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:37.410211 24344 raft_consensus.cc:482] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:37.411077 24344 raft_consensus.cc:3037] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:40:37.439558 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 66237us
I20260807 13:40:37.451566 24344 raft_consensus.cc:504] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:37.456298 24344 leader_election.cc:288] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:37.454881 23447 catalog_manager.cc:5495] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 0 to 1, leader changed from <none> to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 1 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
W20260807 13:40:37.480837 24471 log.cc:924] Time spent T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.065s user 0.001s sys 0.000s
I20260807 13:40:37.461534 23823 raft_consensus.cc:2454] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:37.522285 23884 tablet_bootstrap.cc:654] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:37.526683 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:37.527722 23703 raft_consensus.cc:3037] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:37.535346 24428 raft_consensus.cc:2726] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:37.536491 23704 raft_consensus.cc:2454] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:37.541494 23881 tablet_bootstrap.cc:654] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:37.542233 23555 leader_election.cc:302] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:37.545796 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:37.546392 23823 raft_consensus.cc:3037] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:37.547748 24344 raft_consensus.cc:2781] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:37.561513 23703 raft_consensus.cc:2454] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:37.589910 23555 leader_election.cc:302] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:37.595542 24418 raft_consensus.cc:2781] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:37.581933 24344 raft_consensus.cc:686] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
W20260807 13:40:37.608891 23772 consensus_peers.cc:487] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 -> Peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Couldn't send request to peer 08757cfbeffb41bbab14c2ef00e9d812. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:40:37.603268 24418 raft_consensus.cc:686] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:37.615052 23823 raft_consensus.cc:2454] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:37.614096 24418 consensus_queue.cc:237] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:37.625408 24344 consensus_queue.cc:237] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:37.644770 24090 raft_consensus.cc:482] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:37.645288 24090 raft_consensus.cc:504] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:37.648007 24090 leader_election.cc:288] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:37.648360 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:37.653661 23881 tablet_bootstrap.cc:492] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:37.654184 23881 ts_tablet_manager.cc:1397] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.285s user 0.010s sys 0.016s
W20260807 13:40:37.657635 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 70917.3us
I20260807 13:40:37.663599 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:37.674571 23881 raft_consensus.cc:348] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:37.676924 23881 raft_consensus.cc:374] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:37.677443 23881 raft_consensus.cc:729] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:37.679181 23881 consensus_queue.cc:260] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:37.681659 24063 consensus_queue.cc:1035] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:40:37.681867 23660 leader_election.cc:302] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:37.685932 23888 tablet_bootstrap.cc:492] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:37.686007 24176 raft_consensus.cc:2726] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:37.686462 23888 ts_tablet_manager.cc:1397] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.506s user 0.018s sys 0.037s
I20260807 13:40:37.691797 23881 ts_tablet_manager.cc:1428] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.037s user 0.001s sys 0.008s
I20260807 13:40:37.698531 23888 raft_consensus.cc:348] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:37.706135 23888 raft_consensus.cc:374] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:37.706554 23888 raft_consensus.cc:729] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:37.708568 23888 consensus_queue.cc:260] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:37.714645 23888 ts_tablet_manager.cc:1428] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.026s user 0.007s sys 0.001s
I20260807 13:40:37.716133 23888 tablet_bootstrap.cc:492] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:37.740453 23881 tablet_bootstrap.cc:492] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:37.738197 23700 raft_consensus.cc:3037] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:37.756860 23884 tablet_bootstrap.cc:492] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:37.757520 23884 ts_tablet_manager.cc:1397] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.447s user 0.024s sys 0.002s
I20260807 13:40:37.778350 23884 raft_consensus.cc:348] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:37.781862 23884 raft_consensus.cc:374] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:37.782229 23884 raft_consensus.cc:729] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:37.790195 23884 consensus_queue.cc:260] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:37.790879 23888 tablet_bootstrap.cc:654] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:37.797312 23884 ts_tablet_manager.cc:1428] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.039s user 0.009s sys 0.000s
I20260807 13:40:37.798561 23884 tablet_bootstrap.cc:492] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
W20260807 13:40:38.843115 23509 debug-util.cc:398] Leaking SignalData structure 0x7b080003c100 after lost signal to thread 21836
I20260807 13:40:39.061326 23818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45370 (request call id 138) took 1259 ms. Trace:
I20260807 13:40:39.061932 23818 rpcz_store.cc:276] 0807 13:40:37.801880 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:37.811432 (+ 9552us) service_pool.cc:227] Handling call
0807 13:40:37.831231 (+ 19799us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:39.060756 (+1229525us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:39.060803 (+ 47us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:39.060866 (+ 63us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:39.060913 (+ 47us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:39.060997 (+ 84us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:39.061194 (+ 197us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:40:39.079120 23535 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:40:39.080725 23450 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37962 (request call id 128) took 1281 ms. Trace:
I20260807 13:40:39.081256 23450 rpcz_store.cc:276] 0807 13:40:37.799620 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:37.803149 (+ 3529us) service_pool.cc:227] Handling call
0807 13:40:39.080639 (+1277490us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":1}
I20260807 13:40:39.151175 24485 raft_consensus.cc:482] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:39.151703 24485 raft_consensus.cc:504] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.153584 24485 leader_election.cc:288] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:39.158740 24434 raft_consensus.cc:482] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.159140 24486 raft_consensus.cc:482] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:39.159375 24477 raft_consensus.cc:482] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:39.159868 24477 raft_consensus.cc:504] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.160619 24478 raft_consensus.cc:482] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.161237 24478 raft_consensus.cc:504] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.162004 24477 leader_election.cc:288] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:39.162937 24486 raft_consensus.cc:504] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.163650 24478 leader_election.cc:288] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:39.165592 24486 leader_election.cc:288] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:39.171736 24487 raft_consensus.cc:482] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:39.172199 24487 raft_consensus.cc:504] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.173712 24487 leader_election.cc:288] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:39.177309 24429 raft_consensus.cc:482] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.177845 24429 raft_consensus.cc:504] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.178793 24477 raft_consensus.cc:482] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.179311 24477 raft_consensus.cc:504] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.179976 24429 leader_election.cc:288] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:39.180454 24429 raft_consensus.cc:482] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:39.180867 24429 raft_consensus.cc:504] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.159483 24434 raft_consensus.cc:504] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.181169 24477 leader_election.cc:288] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:39.182394 24477 raft_consensus.cc:482] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.183064 24434 leader_election.cc:288] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:39.182893 24477 raft_consensus.cc:504] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.185317 24477 leader_election.cc:288] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:39.186982 24429 leader_election.cc:288] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:39.195446 24429 raft_consensus.cc:482] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:39.195981 24429 raft_consensus.cc:504] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.196774 24434 raft_consensus.cc:482] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.198243 24434 raft_consensus.cc:504] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.199071 24429 leader_election.cc:288] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:39.199726 24491 raft_consensus.cc:482] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.203650 24491 raft_consensus.cc:504] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.204936 24434 leader_election.cc:288] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:39.202050 24477 raft_consensus.cc:482] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:39.202842 24063 raft_consensus.cc:482] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.206034 24491 leader_election.cc:288] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:39.206334 24063 raft_consensus.cc:504] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.207613 24491 raft_consensus.cc:482] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.208223 24491 raft_consensus.cc:504] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
I20260807 13:40:39.208330 24063 leader_election.cc:288] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:39.208645 24122 raft_consensus.cc:482] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.209405 24477 raft_consensus.cc:504] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.209545 24122 raft_consensus.cc:504] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.210147 24491 leader_election.cc:288] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187)
I20260807 13:40:39.211202 24477 leader_election.cc:288] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:39.212234 24122 leader_election.cc:288] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:39.214118 24063 raft_consensus.cc:482] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:39.214624 24063 raft_consensus.cc:504] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.216358 24063 leader_election.cc:288] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:39.216984 24063 raft_consensus.cc:482] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.217489 24122 raft_consensus.cc:482] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:39.217396 24063 raft_consensus.cc:504] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.218114 24122 raft_consensus.cc:504] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.219177 24063 leader_election.cc:288] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:39.220391 24486 raft_consensus.cc:482] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
W20260807 13:40:39.229570 23509 debug-util.cc:398] Leaking SignalData structure 0x7b080002e1e0 after lost signal to thread 23513
I20260807 13:40:39.230064 24122 leader_election.cc:288] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:39.230569 24122 raft_consensus.cc:482] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:39.231057 24122 raft_consensus.cc:504] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.233171 24122 leader_election.cc:288] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:39.233660 24122 raft_consensus.cc:482] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.234071 24122 raft_consensus.cc:504] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.220690 24493 raft_consensus.cc:482] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.221128 24431 raft_consensus.cc:482] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:39.235065 24431 raft_consensus.cc:504] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.235781 24122 leader_election.cc:288] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:39.236263 24122 raft_consensus.cc:482] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.236853 24122 raft_consensus.cc:504] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.237541 24431 leader_election.cc:288] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:39.222113 24487 raft_consensus.cc:482] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:39.238539 24122 leader_election.cc:288] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:39.238274 24487 raft_consensus.cc:504] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.239058 24122 raft_consensus.cc:482] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:39.239468 24122 raft_consensus.cc:504] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.240170 24487 leader_election.cc:288] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:39.222739 24378 raft_consensus.cc:482] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.227643 24490 raft_consensus.cc:482] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:39.231633 24456 raft_consensus.cc:482] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:39.241629 24378 raft_consensus.cc:504] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.242065 24490 raft_consensus.cc:504] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.243335 24493 raft_consensus.cc:504] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.243852 24378 leader_election.cc:288] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:39.244138 24490 leader_election.cc:288] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:39.244352 24378 raft_consensus.cc:482] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.244616 24490 raft_consensus.cc:482] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:39.244822 24378 raft_consensus.cc:504] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.245184 24176 raft_consensus.cc:482] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:39.245067 24490 raft_consensus.cc:504] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.245419 24493 leader_election.cc:288] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:39.245719 24176 raft_consensus.cc:504] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.228367 24090 raft_consensus.cc:482] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:39.241210 24122 leader_election.cc:288] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:39.242408 24431 raft_consensus.cc:482] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.246881 24090 raft_consensus.cc:504] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.248571 24063 raft_consensus.cc:482] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.250183 24063 raft_consensus.cc:504] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.254992 24063 leader_election.cc:288] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:39.255277 24090 leader_election.cc:288] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:39.255802 21838 debug-util.cc:398] Leaking SignalData structure 0x7b080000e900 after lost signal to thread 23888
I20260807 13:40:39.229641 24486 raft_consensus.cc:504] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.246625 24378 leader_election.cc:288] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:39.257911 21838 kernel_stack_watchdog.cc:198] Thread 23888 stuck at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/thread.cc:637 for 418ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260807 13:40:39.256492 24063 raft_consensus.cc:482] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.242435 24456 raft_consensus.cc:504] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.261552 24063 raft_consensus.cc:504] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.246887 24490 leader_election.cc:288] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:39.263311 23881 tablet_bootstrap.cc:700] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697: Time spent opening tablet: real 1.428s user 0.020s sys 0.020s
I20260807 13:40:39.264916 23881 tablet_bootstrap.cc:654] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:39.252007 24431 raft_consensus.cc:504] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.261236 24491 raft_consensus.cc:482] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:39.261674 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.270339 24063 leader_election.cc:288] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:39.272006 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.281563 23599 raft_consensus.cc:2454] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:39.282375 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.282887 23599 raft_consensus.cc:2454] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:39.283757 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.284354 23884 tablet_bootstrap.cc:654] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:39.266716 24477 raft_consensus.cc:482] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.267554 24490 raft_consensus.cc:482] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:39.289561 24090 raft_consensus.cc:482] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:39.290215 24090 raft_consensus.cc:504] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.314757 24090 leader_election.cc:288] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:39.317186 24090 raft_consensus.cc:482] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:39.317859 24090 raft_consensus.cc:504] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.321272 24490 raft_consensus.cc:504] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.271428 24491 raft_consensus.cc:504] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.360581 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.361390 23590 raft_consensus.cc:2454] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:39.361999 24490 leader_election.cc:288] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:39.362298 24491 leader_election.cc:288] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:39.314571 24477 raft_consensus.cc:504] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.321370 24431 leader_election.cc:288] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:39.363168 24176 leader_election.cc:288] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:39.276546 24456 leader_election.cc:288] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:39.275183 23594 raft_consensus.cc:2454] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:39.363620 24090 leader_election.cc:288] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:39.280045 24486 leader_election.cc:288] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:39.402410 24492 raft_consensus.cc:482] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:39.414906 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.416007 23588 raft_consensus.cc:2454] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:39.407051 24434 raft_consensus.cc:482] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:39.418896 24434 raft_consensus.cc:504] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.404937 24491 raft_consensus.cc:482] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.421463 24491 raft_consensus.cc:504] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.439990 24477 leader_election.cc:288] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:39.442984 24492 raft_consensus.cc:504] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.447582 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.457082 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.465150 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.501739 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.504448 24434 leader_election.cc:288] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:39.505784 24491 leader_election.cc:288] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:39.507292 23590 raft_consensus.cc:2454] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:39.608834 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.609938 23590 raft_consensus.cc:2454] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:39.512220 23588 raft_consensus.cc:2454] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:39.654235 24090 raft_consensus.cc:482] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:39.512566 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.654843 24090 raft_consensus.cc:504] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.564755 24429 raft_consensus.cc:482] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.567436 24478 raft_consensus.cc:482] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.573113 24477 raft_consensus.cc:482] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:39.584895 24456 raft_consensus.cc:482] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:39.606933 23594 raft_consensus.cc:2454] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:39.509938 24492 leader_election.cc:288] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:39.663233 24490 raft_consensus.cc:482] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:39.668457 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.669188 24490 raft_consensus.cc:504] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.669603 23594 raft_consensus.cc:2454] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:39.645255 23772 leader_election.cc:302] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:39.672024 23772 leader_election.cc:302] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:39.666864 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.666626 24456 raft_consensus.cc:504] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.667562 24429 raft_consensus.cc:504] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.671319 24492 raft_consensus.cc:2781] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:39.675318 24090 leader_election.cc:288] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:39.667656 24478 raft_consensus.cc:504] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.677497 23772 leader_election.cc:302] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:39.678627 24176 raft_consensus.cc:482] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:39.679579 24487 raft_consensus.cc:482] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:39.694108 24176 raft_consensus.cc:504] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.696322 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:39.697376 23702 raft_consensus.cc:2454] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:39.684823 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c1184114b02410098331e68d3b8d4cf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:39.699085 23710 raft_consensus.cc:2454] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 0.
I20260807 13:40:39.699520 24431 raft_consensus.cc:482] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:39.686637 24495 raft_consensus.cc:482] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:39.700273 24431 raft_consensus.cc:504] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.687177 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.688457 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:39.680775 24456 leader_election.cc:288] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:39.681756 24492 raft_consensus.cc:482] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.707134 24492 raft_consensus.cc:3037] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:39.708125 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:39.693337 24478 leader_election.cc:288] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:39.694288 24487 raft_consensus.cc:504] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.683787 24063 raft_consensus.cc:2781] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:39.713112 24063 raft_consensus.cc:482] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.669443 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.689105 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.714798 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.716183 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.716703 24487 leader_election.cc:288] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:39.717371 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.698354 24176 leader_election.cc:288] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:39.704458 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.709427 24431 leader_election.cc:288] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:39.689188 24429 leader_election.cc:288] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:39.699471 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:39.690205 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:39.719337 23702 raft_consensus.cc:2454] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:39.706812 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:39.700803 24495 raft_consensus.cc:504] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.718564 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.719717 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.684547 23772 leader_election.cc:302] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:39.713510 24063 raft_consensus.cc:3037] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:39.714401 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:39.720124 23588 raft_consensus.cc:2454] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:39.707923 24490 leader_election.cc:288] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:39.682175 24491 raft_consensus.cc:2781] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:39.725674 24429 raft_consensus.cc:2781] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:39.725976 23772 leader_election.cc:302] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:39.673286 24477 raft_consensus.cc:504] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.732185 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.732690 23599 raft_consensus.cc:2454] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:39.733790 24478 raft_consensus.cc:2781] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:39.734455 24478 raft_consensus.cc:482] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.735728 24478 raft_consensus.cc:3037] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:39.736065 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.737344 23601 raft_consensus.cc:2454] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
W20260807 13:40:39.746450 23700 consensus_meta.cc:287] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 2.005s user 0.009s sys 0.028s
I20260807 13:40:39.749174 24063 raft_consensus.cc:504] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.756704 24063 leader_election.cc:288] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:39.758986 24063 raft_consensus.cc:482] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.759614 24063 raft_consensus.cc:504] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.729898 24429 raft_consensus.cc:482] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.746874 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.730055 24491 raft_consensus.cc:482] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.731580 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.763249 24429 raft_consensus.cc:3037] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:39.774997 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.764804 24491 raft_consensus.cc:3037] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:39.764314 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.764082 23600 raft_consensus.cc:2454] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:39.788511 23772 leader_election.cc:302] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:39.788837 23884 tablet_bootstrap.cc:492] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:39.788964 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.789470 23884 ts_tablet_manager.cc:1397] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 1.991s user 0.038s sys 0.009s
I20260807 13:40:39.790628 23662 leader_election.cc:302] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:39.791654 23772 leader_election.cc:302] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:39.784759 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.793316 23772 leader_election.cc:302] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:39.795516 23772 leader_election.cc:302] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:39.783789 24434 raft_consensus.cc:482] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:39.801795 24063 leader_election.cc:288] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:39.793634 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.794436 24176 raft_consensus.cc:2781] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:39.813422 24063 raft_consensus.cc:2781] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:39.815869 23772 leader_election.cc:302] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:39.817644 24063 raft_consensus.cc:482] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.818025 24063 raft_consensus.cc:3037] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:39.820639 24501 raft_consensus.cc:2781] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:39.821115 24501 raft_consensus.cc:482] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.821218 24502 raft_consensus.cc:2781] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:39.821648 24502 raft_consensus.cc:482] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.821529 24501 raft_consensus.cc:3037] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:39.822140 23772 leader_election.cc:302] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:39.823570 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.812625 24495 leader_election.cc:288] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:39.830389 24328 raft_consensus.cc:482] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.830965 24328 raft_consensus.cc:504] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.834353 24328 leader_election.cc:288] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:39.823724 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:39.835099 24328 raft_consensus.cc:482] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:39.824311 24477 leader_election.cc:288] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:39.802832 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:39.838580 24445 raft_consensus.cc:2781] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:39.838683 23704 raft_consensus.cc:2454] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:39.839308 24445 raft_consensus.cc:482] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.839898 24445 raft_consensus.cc:3037] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:39.803154 24434 raft_consensus.cc:504] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.825942 23881 tablet_bootstrap.cc:492] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:39.841456 23881 ts_tablet_manager.cc:1397] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 2.101s user 0.039s sys 0.038s
I20260807 13:40:39.826963 24500 raft_consensus.cc:2781] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:39.827288 24502 raft_consensus.cc:3037] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:39.828186 24063 raft_consensus.cc:504] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
I20260807 13:40:39.836458 24477 raft_consensus.cc:2781] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260807 13:40:39.841861 23888 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 2.010s user 0.010s sys 0.034s
I20260807 13:40:39.835892 24328 raft_consensus.cc:504] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:39.845965 23888 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 2.014s user 0.010s sys 0.035s
I20260807 13:40:39.848434 24328 leader_election.cc:288] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:39.817543 24176 raft_consensus.cc:482] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:39.859848 23888 tablet_bootstrap.cc:492] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:39.849510 24063 leader_election.cc:288] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187)
I20260807 13:40:39.860690 23888 ts_tablet_manager.cc:1397] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 2.145s user 0.017s sys 0.048s
I20260807 13:40:39.851604 23881 raft_consensus.cc:348] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.862525 23881 raft_consensus.cc:374] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:39.862963 23881 raft_consensus.cc:729] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:39.863883 23881 consensus_queue.cc:260] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.852833 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:39.844020 24500 raft_consensus.cc:482] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.869170 24500 raft_consensus.cc:3037] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:39.875778 23884 raft_consensus.cc:348] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.879621 23884 raft_consensus.cc:374] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:39.880065 23884 raft_consensus.cc:729] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:39.881059 23884 consensus_queue.cc:260] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.849167 24477 raft_consensus.cc:482] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.845078 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:39.893651 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 71719.9us
I20260807 13:40:39.896032 23884 ts_tablet_manager.cc:1428] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.106s user 0.009s sys 0.001s
I20260807 13:40:39.894789 23772 leader_election.cc:302] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:39.871901 24176 raft_consensus.cc:3037] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:39.890319 23881 ts_tablet_manager.cc:1428] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.049s user 0.010s sys 0.002s
I20260807 13:40:39.902596 24063 raft_consensus.cc:2781] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:39.902994 24063 raft_consensus.cc:482] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.903324 24063 raft_consensus.cc:3037] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:39.883162 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:39.892316 24477 raft_consensus.cc:3037] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:39.909524 23772 leader_election.cc:302] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:39.895689 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:39.913942 23881 tablet_bootstrap.cc:492] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:39.914528 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:39.920439 23703 raft_consensus.cc:2454] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:39.922964 24499 raft_consensus.cc:482] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:39.906044 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:39.924189 24499 raft_consensus.cc:504] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:39.930322 24504 raft_consensus.cc:2781] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:39.934558 24504 raft_consensus.cc:482] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:39.914529 24434 leader_election.cc:288] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:39.961915 23884 tablet_bootstrap.cc:492] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:39.961797 24504 raft_consensus.cc:3037] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:39.992661 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:39.993135 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:40.003142 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:40.003786 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:40.005847 24456 raft_consensus.cc:482] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:40.006451 24496 raft_consensus.cc:482] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:40.006856 24456 raft_consensus.cc:504] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.007738 24063 raft_consensus.cc:504] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.007606 24496 raft_consensus.cc:504] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.015295 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:40.018224 24063 leader_election.cc:288] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:40.019927 23447 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37968 (request call id 118) took 2207 ms. Trace:
I20260807 13:40:40.020439 23447 rpcz_store.cc:276] 0807 13:40:37.803323 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:37.803501 (+ 178us) service_pool.cc:227] Handling call
0807 13:40:40.010865 (+2207364us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":1}
I20260807 13:40:40.134596 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.021493 23888 raft_consensus.cc:348] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.267524 23888 raft_consensus.cc:374] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:40.268031 23888 raft_consensus.cc:729] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:40.207195 24491 raft_consensus.cc:504] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.056347 24496 leader_election.cc:288] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:40.109863 24063 raft_consensus.cc:482] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:40.268953 23888 consensus_queue.cc:260] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.276377 24063 raft_consensus.cc:504] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.022787 24090 raft_consensus.cc:482] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:40.277556 24090 raft_consensus.cc:504] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.131942 23820 raft_consensus.cc:1226] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:40.021938 23448 catalog_manager.cc:5495] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 0 to 1, leader changed from <none> to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 1 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:40.070147 23598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 304) took 2265 ms. Trace:
I20260807 13:40:40.151921 24499 leader_election.cc:288] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:40:40.121532 24503 log.cc:924] Time spent T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.062s user 0.001s sys 0.000s
I20260807 13:40:40.232687 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:40.296715 24090 leader_election.cc:288] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:40.271633 24429 raft_consensus.cc:504] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.296782 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:40.310322 23535 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:40:40.313675 23888 ts_tablet_manager.cc:1428] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.453s user 0.009s sys 0.009s
I20260807 13:40:40.289940 23598 rpcz_store.cc:276] 0807 13:40:37.802905 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:37.803044 (+ 139us) service_pool.cc:227] Handling call
0807 13:40:40.067309 (+2264265us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:40.067501 (+ 192us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:40.067541 (+ 40us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:40.067592 (+ 51us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:40.067619 (+ 27us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:40.067674 (+ 55us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:40.067812 (+ 138us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:40.316550 24063 leader_election.cc:288] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:40:40.319150 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 406720us
I20260807 13:40:40.019196 24456 leader_election.cc:288] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:40.131104 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.132202 24431 raft_consensus.cc:482] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:40.322099 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.232334 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:40.310521 24499 raft_consensus.cc:482] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:40.010046 24492 raft_consensus.cc:504] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.304152 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:40.341418 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:40.342558 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:40.345304 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:40.332599 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:40.334329 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:40.346240 23598 raft_consensus.cc:2454] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:40.346275 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:40.324179 23509 debug-util.cc:398] Leaking SignalData structure 0x7b08002aed00 after lost signal to thread 23637
I20260807 13:40:40.347208 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:40.319702 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:40.355151 23823 raft_consensus.cc:1226] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: []
W20260807 13:40:40.350124 23509 debug-util.cc:398] Leaking SignalData structure 0x7b08002aed20 after lost signal to thread 23638
I20260807 13:40:40.339785 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:40.336234 23818 raft_consensus.cc:2454] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:40.363888 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:40.370118 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.354440 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:40.332106 24431 raft_consensus.cc:504] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.344076 24499 raft_consensus.cc:504] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.336802 24501 raft_consensus.cc:504] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.351194 24504 raft_consensus.cc:504] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.413218 23772 leader_election.cc:302] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:40.414142 24063 raft_consensus.cc:2781] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:40.415087 24504 leader_election.cc:288] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:40.415985 23820 raft_consensus.cc:1226] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:40.414594 24063 raft_consensus.cc:482] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:40.416638 24063 raft_consensus.cc:3037] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:40.387097 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:40.438645 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.440457 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:40.441103 23597 raft_consensus.cc:3037] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:40.440984 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
W20260807 13:40:40.445030 24477 consensus_meta.cc:287] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.532s user 0.023s sys 0.007s
I20260807 13:40:40.445451 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.445572 24477 raft_consensus.cc:504] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.445648 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.447057 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 142) took 2710 ms. Trace:
I20260807 13:40:40.447683 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.448660 23814 raft_consensus.cc:2454] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:40.453295 23594 raft_consensus.cc:3037] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:40.473951 23601 raft_consensus.cc:3037] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:40:40.475178 23509 debug-util.cc:398] Leaking SignalData structure 0x7b0800243960 after lost signal to thread 23751
I20260807 13:40:40.475306 24429 leader_election.cc:288] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:40:40.475804 23509 debug-util.cc:398] Leaking SignalData structure 0x7b080002d8c0 after lost signal to thread 23752
I20260807 13:40:40.476341 24492 leader_election.cc:288] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:40:40.477553 23509 debug-util.cc:398] Leaking SignalData structure 0x7b08002794e0 after lost signal to thread 23861
I20260807 13:40:40.477840 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:40.440457 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.449971 23591 raft_consensus.cc:2454] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:40.461305 23821 raft_consensus.cc:1226] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:40.454003 24491 leader_election.cc:288] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:40.489001 23595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 306) took 1248 ms. Trace:
I20260807 13:40:40.489990 23888 tablet_bootstrap.cc:492] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:40.469700 24431 leader_election.cc:288] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:40.457834 24445 consensus_meta.cc:287] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.617s user 0.002s sys 0.044s
I20260807 13:40:40.500360 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.500834 24445 raft_consensus.cc:504] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.501272 23814 raft_consensus.cc:2454] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:40.502261 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.502948 23823 raft_consensus.cc:2454] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:40.480983 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:40.483289 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:40.478971 24063 raft_consensus.cc:504] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.485344 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:40.485399 23597 raft_consensus.cc:2454] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:40.504941 23598 raft_consensus.cc:3037] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:40.505321 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:40.507304 21838 debug-util.cc:398] Leaking SignalData structure 0x7b080000e7a0 after lost signal to thread 23888
I20260807 13:40:40.511653 24514 raft_consensus.cc:482] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:40.511704 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.512531 23820 raft_consensus.cc:2454] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:40.485364 23884 tablet_bootstrap.cc:654] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:40.486897 23813 raft_consensus.cc:1226] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:40.488420 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.488575 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.489542 23595 rpcz_store.cc:276] 0807 13:40:39.240729 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:39.251663 (+ 10934us) service_pool.cc:227] Handling call
0807 13:40:40.477675 (+1226012us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b5800001898. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914dbce 000000000034aea9 00007f4620f79a30 00007f462103f7b4 00007f462103f821 00007f4620fef1b0 00007f4620feea94 00007f461a6d6c04 00007f461a6d6b92
0807 13:40:40.488880 (+ 11205us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2980736}
W20260807 13:40:40.475243 24478 consensus_meta.cc:287] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.739s user 0.013s sys 0.013s
I20260807 13:40:40.494057 23594 raft_consensus.cc:2454] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:40.495507 23881 tablet_bootstrap.cc:654] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:40.495169 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:40.496582 24176 consensus_meta.cc:287] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.585s user 0.009s sys 0.005s
W20260807 13:40:40.497670 24502 consensus_meta.cc:287] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.644s user 0.008s sys 0.010s
I20260807 13:40:40.497287 23812 raft_consensus.cc:2454] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:40.519380 23598 raft_consensus.cc:2454] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:40.512400 24514 raft_consensus.cc:504] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.521103 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.523550 24519 raft_consensus.cc:482] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:40.522387 23772 leader_election.cc:302] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:40.524571 23821 raft_consensus.cc:1226] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:40.532522 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.530617 23820 raft_consensus.cc:2454] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:40.533893 24063 leader_election.cc:288] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:40.532963 23818 raft_consensus.cc:2454] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:40.534988 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:40.536078 23821 raft_consensus.cc:1226] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:40.536370 23818 raft_consensus.cc:1226] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:40.529372 24478 raft_consensus.cc:504] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.447552 23700 rpcz_store.cc:276] 0807 13:40:37.736785 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:37.737010 (+ 225us) service_pool.cc:227] Handling call
0807 13:40:37.737916 (+ 906us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:39.765746 (+2027830us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:39.767939 (+ 2193us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:39.813300 (+ 45361us) log.cc:842] Serialized 26 byte log entry
0807 13:40:39.902598 (+ 89298us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:40.351167 (+448569us) log.cc:842] Serialized 14 byte log entry
0807 13:40:40.361031 (+ 9864us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:40.371414 (+ 10383us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:40.426200 (+ 54786us) raft_consensus.cc:1671] finished
0807 13:40:40.441861 (+ 15661us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:40.446929 (+ 5068us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":426814,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":5967,"raft.run_cpu_time_us":390,"raft.run_wall_time_us":21450,"thread_start_us":451962,"threads_started":2,"wal-append.queue_time_us":156304}
I20260807 13:40:40.504928 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.527623 23817 raft_consensus.cc:2454] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
W20260807 13:40:40.540452 23772 leader_election.cc:341] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:40.532514 23597 raft_consensus.cc:1226] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:40.521131 24495 raft_consensus.cc:482] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
W20260807 13:40:40.593464 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 53061us
I20260807 13:40:40.531203 24176 raft_consensus.cc:504] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.610184 23772 leader_election.cc:302] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:40.614615 24063 raft_consensus.cc:2781] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:40.615300 24063 raft_consensus.cc:686] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:40.614114 23772 leader_election.cc:302] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:40.590167 23600 raft_consensus.cc:1226] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:40.539186 24492 raft_consensus.cc:2781] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:40.631656 24477 leader_election.cc:288] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:40.632707 24514 leader_election.cc:288] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:40.533746 24502 raft_consensus.cc:504] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.592545 24519 raft_consensus.cc:504] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:40.626885 24500 consensus_meta.cc:287] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.748s user 0.014s sys 0.005s
I20260807 13:40:40.638648 24063 consensus_queue.cc:237] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.765712 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:40.766120 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:40.739749 24176 leader_election.cc:288] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:40.766791 23599 raft_consensus.cc:3037] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:40.768808 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:40.769570 23594 raft_consensus.cc:3037] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:40.772594 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.772650 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:40.777565 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:40.779758 23660 leader_election.cc:302] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:40.638518 24492 raft_consensus.cc:686] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:40.781690 23660 leader_election.cc:302] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:40.782544 24516 raft_consensus.cc:2726] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:40.782264 24492 consensus_queue.cc:237] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.783336 24516 raft_consensus.cc:2726] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:40.783216 24514 consensus_queue.cc:1046] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:40.784408 23660 leader_election.cc:302] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:40.659392 23817 raft_consensus.cc:1226] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:40.785547 24456 raft_consensus.cc:2726] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:40.647895 24429 raft_consensus.cc:2781] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:40.787411 24429 raft_consensus.cc:686] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:40.717123 23814 raft_consensus.cc:1226] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:40.789531 23660 leader_election.cc:302] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:40.636539 24478 leader_election.cc:288] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:40.790797 23660 leader_election.cc:302] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:40.792068 23660 leader_election.cc:302] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:40.788937 24429 consensus_queue.cc:237] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.814904 23599 raft_consensus.cc:2454] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:40.618048 24445 leader_election.cc:288] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:40.643965 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:40.824399 24519 leader_election.cc:288] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:40.825276 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c1184114b02410098331e68d3b8d4cf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.825598 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.825727 24499 leader_election.cc:288] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:40.826171 23814 raft_consensus.cc:2454] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 0.
I20260807 13:40:40.830211 23888 tablet_bootstrap.cc:654] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
W20260807 13:40:40.818192 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 60090.7us
I20260807 13:40:40.813014 23660 leader_election.cc:302] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:40.818317 23881 tablet_bootstrap.cc:492] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:40.636427 23813 raft_consensus.cc:1226] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:40.834064 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.834745 23881 ts_tablet_manager.cc:1397] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.929s user 0.030s sys 0.047s
I20260807 13:40:40.691021 24496 raft_consensus.cc:482] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:40.611033 24495 raft_consensus.cc:504] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.839519 23660 leader_election.cc:302] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:40.816442 24462 raft_consensus.cc:2781] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:40.842124 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:40.816823 24456 raft_consensus.cc:2726] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:40.819170 24490 raft_consensus.cc:2726] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:40.790987 24500 raft_consensus.cc:504] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.848595 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:40.852473 23884 tablet_bootstrap.cc:492] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:40.853091 23884 ts_tablet_manager.cc:1397] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.926s user 0.029s sys 0.026s
I20260807 13:40:40.831602 24478 raft_consensus.cc:482] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:40.862253 23884 raft_consensus.cc:348] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:40.904150 24523 log.cc:924] Time spent T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.124s user 0.000s sys 0.002s
I20260807 13:40:40.949783 23709 raft_consensus.cc:1226] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:40.931510 24500 leader_election.cc:288] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:40.864795 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c1184114b02410098331e68d3b8d4cf" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:40.942905 23825 raft_consensus.cc:1226] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:40.957150 23595 raft_consensus.cc:2454] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:40.874007 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.881776 23591 raft_consensus.cc:1226] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:40.958164 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.923619 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.855571 24487 raft_consensus.cc:2781] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:40.878352 24495 leader_election.cc:288] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:40.959605 24487 raft_consensus.cc:482] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:40.959810 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.855291 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.937992 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.896750 23881 raft_consensus.cc:348] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.960984 23825 raft_consensus.cc:2379] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 2: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:40.882054 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.961402 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.843266 24496 raft_consensus.cc:504] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.962252 23821 raft_consensus.cc:2379] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 2: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:40.910920 24509 consensus_queue.cc:1046] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260807 13:40:40.844518 24462 raft_consensus.cc:482] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:40.962929 24462 raft_consensus.cc:3037] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:40.882392 23600 raft_consensus.cc:1226] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:40.961040 23812 raft_consensus.cc:2379] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 2: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:40.964143 24509 raft_consensus.cc:3032] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:40.965283 24509 raft_consensus.cc:729] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:40.906280 23815 raft_consensus.cc:1226] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:40.924675 23594 raft_consensus.cc:2454] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:40.966293 24509 consensus_queue.cc:260] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.959936 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.967119 23598 raft_consensus.cc:1226] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:40.967757 24509 raft_consensus.cc:3037] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:40.968619 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:40.969058 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:40.969336 23709 raft_consensus.cc:2454] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:40.869635 24456 consensus_queue.cc:1046] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.100s
I20260807 13:40:40.864682 24090 raft_consensus.cc:3032] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:40.970459 24090 raft_consensus.cc:729] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:40.970917 24456 raft_consensus.cc:3032] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:40.876777 24502 leader_election.cc:288] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:40.971089 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:40.864073 24478 raft_consensus.cc:504] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.905087 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.891937 23772 leader_election.cc:302] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:40.878047 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:40.973234 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 81421.3us
I20260807 13:40:40.973356 24478 leader_election.cc:288] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:40.911274 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.843081 24516 raft_consensus.cc:2726] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:40.974061 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:40.870639 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:40.974923 23884 raft_consensus.cc:374] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:40.976450 23881 raft_consensus.cc:374] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:40.975442 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:40.976861 23881 raft_consensus.cc:729] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:40.976095 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:40.977591 23881 consensus_queue.cc:260] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:40.978284 23707 raft_consensus.cc:2454] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:40.975416 23884 raft_consensus.cc:729] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:40.959127 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:40.973878 24478 raft_consensus.cc:2781] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:40.960177 24487 raft_consensus.cc:3037] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:40.971462 24456 raft_consensus.cc:729] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:41.003873 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.005594 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:41.005977 23772 leader_election.cc:302] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:40.993561 23881 ts_tablet_manager.cc:1428] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.156s user 0.005s sys 0.008s
I20260807 13:40:40.979871 23884 consensus_queue.cc:260] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:41.008167 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 168714us
I20260807 13:40:40.983250 24090 consensus_queue.cc:260] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
I20260807 13:40:41.007223 24462 raft_consensus.cc:504] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.009855 24063 raft_consensus.cc:2781] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:41.010157 24090 raft_consensus.cc:3037] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:41.010289 24063 raft_consensus.cc:482] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:41.010821 24063 raft_consensus.cc:3037] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:41.014907 23660 leader_election.cc:302] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:41.015244 23881 tablet_bootstrap.cc:492] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:41.016347 23660 leader_election.cc:302] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:41.017442 23660 leader_election.cc:302] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:41.021245 23884 ts_tablet_manager.cc:1428] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.168s user 0.012s sys 0.000s
I20260807 13:40:41.009235 24529 consensus_queue.cc:1046] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260807 13:40:40.876921 24501 leader_election.cc:288] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:40.964172 24496 leader_election.cc:288] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:41.021996 24490 raft_consensus.cc:2781] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:41.029126 24490 raft_consensus.cc:482] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:41.011590 24478 raft_consensus.cc:686] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:41.029603 24490 raft_consensus.cc:3037] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:41.030833 24462 leader_election.cc:288] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:41.030483 24478 consensus_queue.cc:237] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.018590 24495 consensus_queue.cc:1046] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260807 13:40:41.035391 23884 tablet_bootstrap.cc:492] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:40.976370 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.022544 24514 raft_consensus.cc:2781] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:41.043488 23772 leader_election.cc:302] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:41.045951 24063 raft_consensus.cc:504] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.014016 24516 consensus_queue.cc:1046] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260807 13:40:41.008770 24456 consensus_queue.cc:260] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.049819 24063 leader_election.cc:288] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:40:41.036175 23769 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.82.66:38833 timed out after 1.530s (SENT) [suppressed 3 similar messages]
I20260807 13:40:41.033277 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.049780 23772 leader_election.cc:302] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:41.116892 24456 raft_consensus.cc:3037] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:40:41.118192 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 68326.9us
I20260807 13:40:41.123371 24491 raft_consensus.cc:2781] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:41.124390 24491 raft_consensus.cc:686] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:41.105979 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:41.107825 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 90206.1us
I20260807 13:40:41.022763 24176 consensus_queue.cc:1046] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260807 13:40:41.044019 24496 raft_consensus.cc:2781] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:41.137634 24496 raft_consensus.cc:482] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:41.051748 24502 raft_consensus.cc:2781] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:41.138603 24462 raft_consensus.cc:3032] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:41.139259 24462 raft_consensus.cc:729] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:41.139321 24502 raft_consensus.cc:482] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:41.140014 24502 raft_consensus.cc:3037] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:41.141126 24462 consensus_queue.cc:260] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:40.984534 23554 leader_election.cc:341] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:40:41.143230 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 158610us
I20260807 13:40:41.144567 23554 leader_election.cc:302] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:41.144832 24516 raft_consensus.cc:482] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:41.145289 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.048007 24514 raft_consensus.cc:482] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:41.056870 24519 consensus_queue.cc:1046] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260807 13:40:41.145684 24516 raft_consensus.cc:504] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.146525 24514 raft_consensus.cc:3037] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:41.127714 23660 leader_election.cc:302] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:41.053721 23888 tablet_bootstrap.cc:492] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:41.152069 24489 consensus_queue.cc:1035] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:41.138338 24496 raft_consensus.cc:3037] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:41.153821 23888 ts_tablet_manager.cc:1397] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.670s user 0.014s sys 0.019s
W20260807 13:40:41.148509 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 112480us
I20260807 13:40:41.116925 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.151037 24485 raft_consensus.cc:2781] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:41.162225 23595 raft_consensus.cc:2454] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:41.162447 24491 consensus_queue.cc:237] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.158013 24485 raft_consensus.cc:482] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:41.164585 24485 raft_consensus.cc:3037] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:41.169966 24516 leader_election.cc:288] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:41.172753 23660 leader_election.cc:302] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:41.173188 24462 raft_consensus.cc:3037] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:41.174357 24529 consensus_queue.cc:1046] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:41.176031 24547 raft_consensus.cc:2781] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:41.176167 24529 raft_consensus.cc:3032] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:41.176278 23660 leader_election.cc:302] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:41.176553 24547 raft_consensus.cc:482] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:41.184772 24547 raft_consensus.cc:3037] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:41.192871 24176 raft_consensus.cc:2726] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:41.176734 24529 raft_consensus.cc:729] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
W20260807 13:40:41.195703 24526 log.cc:924] Time spent T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da: Append to log took a long time: real 0.062s user 0.000s sys 0.001s
I20260807 13:40:41.196789 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.200238 24529 consensus_queue.cc:260] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.186474 23888 raft_consensus.cc:348] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.210307 23888 raft_consensus.cc:374] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:41.210758 23888 raft_consensus.cc:729] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:41.211992 23884 tablet_bootstrap.cc:654] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:41.207407 23705 raft_consensus.cc:2454] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:41.228541 24176 raft_consensus.cc:2781] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:41.229166 24176 raft_consensus.cc:482] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:41.229593 24176 raft_consensus.cc:3037] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:40:41.245471 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 81585us
I20260807 13:40:41.239964 24529 raft_consensus.cc:3037] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:41.262624 23815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45360 (request call id 315) took 1077 ms. Trace:
I20260807 13:40:41.322909 24486 raft_consensus.cc:482] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:41.323668 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.324002 23821 raft_consensus.cc:1226] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:41.323899 24486 raft_consensus.cc:504] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
I20260807 13:40:41.327067 24486 leader_election.cc:288] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:41.328300 23448 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37954 (request call id 118) took 3609 ms. Trace:
I20260807 13:40:41.328615 24490 raft_consensus.cc:504] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.330171 23704 raft_consensus.cc:2379] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 2: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:41.215056 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
W20260807 13:40:41.347469 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 171279us
I20260807 13:40:41.343343 23888 consensus_queue.cc:260] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.349675 23660 leader_election.cc:302] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:41.352506 23660 leader_election.cc:302] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:41.353505 24516 raft_consensus.cc:2781] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:41.354069 24516 raft_consensus.cc:482] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:41.353588 24502 raft_consensus.cc:504] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.354553 24516 raft_consensus.cc:3037] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:41.330374 24485 raft_consensus.cc:504] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.371726 24462 raft_consensus.cc:2726] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:41.393201 24554 raft_consensus.cc:482] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:41.323199 23815 rpcz_store.cc:276] 0807 13:40:40.185342 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:40.231081 (+ 45739us) service_pool.cc:227] Handling call
0807 13:40:40.765223 (+534142us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b5800255098. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f46210032b0 00007f4620fee7f9 00007f4620fee2a2 00007f461a6d4684
0807 13:40:40.765573 (+ 350us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:40.966852 (+201279us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:41.261705 (+294853us) spinlock_profiling.cc:243] Waited 55 ms on lock 0x7b54002260d4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:40:41.262247 (+ 542us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":175683712}
I20260807 13:40:41.379783 24502 leader_election.cc:288] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:41.328722 23448 rpcz_store.cc:276] 0807 13:40:37.718509 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:37.798939 (+ 80430us) service_pool.cc:227] Handling call
0807 13:40:41.328024 (+3529085us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:40:40.505206 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:40:40.535513 (+ 30307us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:40:40.535555 (+ 42us) write_op.cc:435] Acquired schema lock
0807 13:40:40.535574 (+ 19us) tablet.cc:660] Decoding operations
0807 13:40:40.536144 (+ 570us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:40:40.536240 (+ 96us) write_op.cc:641] Partition lock acquired for write op
0807 13:40:40.536290 (+ 50us) tablet.cc:683] Acquiring locks for 1 operations
0807 13:40:40.536631 (+ 341us) tablet.cc:699] Row locks acquired
0807 13:40:40.536679 (+ 48us) write_op.cc:260] PREPARE: finished
0807 13:40:40.536944 (+ 265us) write_op.cc:270] Start()
0807 13:40:40.537098 (+ 154us) write_op.cc:276] Timestamp: P: 1786110040536862 usec, L: 0
0807 13:40:40.539036 (+ 1938us) op_driver.cc:331] REPLICATION: starting
0807 13:40:40.596275 (+ 57239us) log.cc:842] Serialized 537 byte log entry
0807 13:40:40.912485 (+316210us) op_driver.cc:444] REPLICATION: finished
0807 13:40:41.049112 (+136627us) write_op.cc:301] APPLY: starting
0807 13:40:41.051001 (+ 1889us) tablet.cc:1365] starting BulkCheckPresence
0807 13:40:41.052242 (+ 1241us) tablet.cc:1368] finished BulkCheckPresence
0807 13:40:41.052445 (+ 203us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:40:41.052713 (+ 268us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:40:41.052986 (+ 273us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 13:40:41.053034 (+ 48us) write_op.cc:312] APPLY: finished
0807 13:40:41.064711 (+ 11677us) log.cc:842] Serialized 22 byte log entry
0807 13:40:41.167531 (+102820us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:40:41.167750 (+ 219us) write_op.cc:454] Released schema lock
0807 13:40:41.167865 (+ 115us) write_op.cc:341] FINISH: Updating metrics
0807 13:40:41.197818 (+ 29953us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:40:41.201306 (+ 3488us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":85116,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":113622,"apply.run_cpu_time_us":4208,"apply.run_wall_time_us":176215,"num_ops":1,"prepare.queue_time_us":209228,"prepare.run_cpu_time_us":21437,"prepare.run_wall_time_us":248989,"raft.queue_time_us":67393,"raft.run_cpu_time_us":7405,"raft.run_wall_time_us":76262,"replication_time_us":323245,"thread_start_us":582586,"threads_started":4,"wal-append.queue_time_us":184049}]]}
I20260807 13:40:41.406630 23700 raft_consensus.cc:2454] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:41.394025 24554 raft_consensus.cc:504] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.410018 24544 raft_consensus.cc:3032] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:41.409940 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.407485 23660 leader_election.cc:302] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:41.406684 24490 leader_election.cc:288] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:41.417307 23888 ts_tablet_manager.cc:1428] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.263s user 0.047s sys 0.043s
I20260807 13:40:41.402536 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.425817 24090 raft_consensus.cc:2781] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:41.426258 24090 raft_consensus.cc:482] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:41.426018 24487 raft_consensus.cc:504] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.426682 24090 raft_consensus.cc:3037] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:41.427670 23660 leader_election.cc:302] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:41.430688 24543 raft_consensus.cc:3032] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:41.431173 24543 raft_consensus.cc:729] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:41.432260 24543 consensus_queue.cc:260] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.434206 24543 raft_consensus.cc:3037] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:41.418895 24544 raft_consensus.cc:729] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:41.436283 24485 leader_election.cc:288] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:41.436674 23709 raft_consensus.cc:2454] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:41.437106 24554 leader_election.cc:288] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:41.440301 24544 consensus_queue.cc:260] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.442191 24544 raft_consensus.cc:3037] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:41.441778 24516 raft_consensus.cc:504] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.455752 24559 raft_consensus.cc:2726] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:41.456182 24495 raft_consensus.cc:3032] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:41.458555 24495 raft_consensus.cc:729] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:41.460371 23662 leader_election.cc:302] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:41.461766 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.462028 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:41.459930 24495 consensus_queue.cc:260] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.465279 24548 raft_consensus.cc:2781] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:41.467487 24548 raft_consensus.cc:482] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:41.467718 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.467990 24548 raft_consensus.cc:3037] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:41.467859 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.465366 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.474699 24487 leader_election.cc:288] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:41.412580 24462 consensus_queue.cc:1046] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260807 13:40:41.475886 24462 raft_consensus.cc:3032] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:41.476279 24462 raft_consensus.cc:729] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:41.464308 23660 leader_election.cc:302] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:41.463446 24456 consensus_queue.cc:1046] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260807 13:40:41.470741 24519 raft_consensus.cc:482] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:41.484757 24519 raft_consensus.cc:504] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.473209 23449 catalog_manager.cc:5495] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 1 to 2, leader changed from 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66) to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 2 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:41.450534 24516 leader_election.cc:288] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:41.479501 24176 raft_consensus.cc:504] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.480125 23888 tablet_bootstrap.cc:492] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:41.486932 24090 raft_consensus.cc:504] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.493808 23449 catalog_manager.cc:5495] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 1 to 2, leader changed from 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66) to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 2 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:41.494606 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.499236 23705 raft_consensus.cc:2379] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 2: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
W20260807 13:40:41.519443 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 62921.1us
I20260807 13:40:41.520606 24519 leader_election.cc:288] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:41.523245 24462 consensus_queue.cc:260] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.526170 23703 raft_consensus.cc:2454] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:41.490562 24487 raft_consensus.cc:2726] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:41.525043 24090 leader_election.cc:288] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:41.530472 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:41.495596 24554 consensus_queue.cc:1035] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260807 13:40:41.534521 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
W20260807 13:40:41.538206 23554 leader_election.cc:341] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:41.535101 24487 consensus_queue.cc:1046] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260807 13:40:41.543645 24487 raft_consensus.cc:3032] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:41.543998 24487 raft_consensus.cc:729] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:41.543994 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:41.544963 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:41.546063 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:41.546442 23881 tablet_bootstrap.cc:654] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:41.547640 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:41.548775 24487 consensus_queue.cc:260] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.535328 24495 raft_consensus.cc:3037] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:41.555125 24176 leader_election.cc:288] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:41.556631 24529 raft_consensus.cc:3032] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:41.557370 24529 raft_consensus.cc:729] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
W20260807 13:40:41.561312 24555 log.cc:924] Time spent T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.137s user 0.000s sys 0.001s
I20260807 13:40:41.559938 24529 consensus_queue.cc:260] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.563619 24529 raft_consensus.cc:3037] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:41.564733 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:41.567142 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:41.571484 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.571484 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.575105 23709 raft_consensus.cc:2379] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 2: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:41.575529 23707 raft_consensus.cc:2454] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:41.571622 24176 raft_consensus.cc:482] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:41.576174 24176 raft_consensus.cc:504] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.577926 24176 leader_election.cc:288] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:41.578832 24176 consensus_queue.cc:1046] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:41.579118 24490 consensus_queue.cc:1046] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:41.580490 24516 raft_consensus.cc:3032] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:41.580714 24176 raft_consensus.cc:3032] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:41.580941 24516 raft_consensus.cc:729] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:41.581136 24176 raft_consensus.cc:729] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:41.582010 24516 consensus_queue.cc:260] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.582013 24176 consensus_queue.cc:260] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.588027 24509 raft_consensus.cc:482] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:41.592813 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:41.591493 23703 raft_consensus.cc:2454] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:41.593360 24516 raft_consensus.cc:3037] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:41.600468 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:41.600164 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:41.602459 23884 tablet_bootstrap.cc:492] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:41.573939 24487 raft_consensus.cc:3037] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:41.602743 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c1184114b02410098331e68d3b8d4cf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:41.604665 23818 raft_consensus.cc:2379] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 2: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:41.605051 23820 raft_consensus.cc:2379] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 1: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:41.605403 23884 ts_tablet_manager.cc:1397] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.579s user 0.028s sys 0.030s
I20260807 13:40:41.603183 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:41.613857 23825 raft_consensus.cc:2379] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 2: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:41.615041 24456 raft_consensus.cc:482] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:41.615244 24462 raft_consensus.cc:3037] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:41.616232 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.616950 23703 raft_consensus.cc:2379] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 2: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:41.572285 24514 raft_consensus.cc:504] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.622458 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.623888 23709 raft_consensus.cc:2379] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 2: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:41.615759 24456 raft_consensus.cc:504] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.627053 24176 raft_consensus.cc:3037] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:41.627888 24456 leader_election.cc:288] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:41.633004 23884 raft_consensus.cc:348] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.633760 23884 raft_consensus.cc:374] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:41.634047 23884 raft_consensus.cc:729] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:41.638152 23884 consensus_queue.cc:260] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.571830 24547 raft_consensus.cc:504] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.615896 24509 raft_consensus.cc:504] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.646862 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:41.649559 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:41.650553 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:41.651278 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:41.651394 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:41.651636 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:41.612051 24496 raft_consensus.cc:504] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.640358 24544 raft_consensus.cc:482] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:41.636356 24548 raft_consensus.cc:504] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.664718 23884 ts_tablet_manager.cc:1428] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.059s user 0.006s sys 0.001s
I20260807 13:40:41.665414 23888 tablet_bootstrap.cc:654] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:41.666393 23703 raft_consensus.cc:2454] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:41.668172 24090 raft_consensus.cc:482] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:41.644513 24456 raft_consensus.cc:482] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:41.667553 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:41.672046 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:41.675209 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:41.675747 23710 raft_consensus.cc:2379] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 2: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:41.678920 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:41.680361 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.683372 24090 raft_consensus.cc:504] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.680253 24486 consensus_queue.cc:1035] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:41.686383 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:41.686002 23711 raft_consensus.cc:2454] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:41.689713 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c1184114b02410098331e68d3b8d4cf" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:41.690176 23711 raft_consensus.cc:3037] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:41.686185 23710 raft_consensus.cc:2379] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 2: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:41.692080 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:41.693248 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.685639 23707 raft_consensus.cc:2454] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:41.696348 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:41.697151 24090 leader_election.cc:288] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:41.698992 23660 leader_election.cc:302] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:41.702309 24090 raft_consensus.cc:2726] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:41.702603 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.703058 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:41.689059 24496 leader_election.cc:288] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:41.736219 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.736654 24499 raft_consensus.cc:482] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:41.737355 24499 raft_consensus.cc:504] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.742026 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:41.678764 24544 raft_consensus.cc:504] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.705740 24509 leader_election.cc:288] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:41.736546 24496 consensus_queue.cc:1046] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:41.745543 23881 tablet_bootstrap.cc:492] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:41.694176 24456 raft_consensus.cc:504] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.753643 24529 raft_consensus.cc:482] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:41.752312 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:41.753147 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:41.746745 23825 raft_consensus.cc:1226] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:41.747129 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:41.771656 23711 raft_consensus.cc:2454] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:41.752678 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:41.746091 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:41.746073 23709 raft_consensus.cc:2454] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:41.781533 23823 raft_consensus.cc:2454] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:41.742285 24548 leader_election.cc:288] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:41.792603 23881 ts_tablet_manager.cc:1397] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.781s user 0.027s sys 0.031s
I20260807 13:40:41.782176 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:41.793177 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:41.781167 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:41.799120 23820 raft_consensus.cc:2454] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:41.799882 23699 raft_consensus.cc:2454] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:41.782451 24529 raft_consensus.cc:504] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.755342 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:41.742116 24499 leader_election.cc:288] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:41.803323 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:41.753481 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:41.803345 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.804993 23703 raft_consensus.cc:2454] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:41.805902 24529 leader_election.cc:288] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:41.798563 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.823894 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:41.821962 23881 raft_consensus.cc:348] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.824280 23707 raft_consensus.cc:2362] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2. Re-sending same reply.
I20260807 13:40:41.825603 23881 raft_consensus.cc:374] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:41.825901 23881 raft_consensus.cc:729] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:41.826787 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:41.827592 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.808264 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.785509 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:41.810796 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.838188 23711 raft_consensus.cc:2362] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2. Re-sending same reply.
I20260807 13:40:41.814066 23704 raft_consensus.cc:2454] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:41.770918 24496 raft_consensus.cc:3032] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:41.773605 24514 leader_election.cc:288] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:41.819052 23884 tablet_bootstrap.cc:492] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:41.819861 23710 raft_consensus.cc:2454] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:41.821354 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:41.821915 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:41.822304 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:41.822765 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c1184114b02410098331e68d3b8d4cf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:41.849740 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:41.850366 23812 raft_consensus.cc:2379] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 1: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:41.823031 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.850905 23703 raft_consensus.cc:2454] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:41.851691 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c1184114b02410098331e68d3b8d4cf" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.852195 23703 raft_consensus.cc:2362] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1. Re-sending same reply.
W20260807 13:40:41.806831 24563 log.cc:924] Time spent T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.052s user 0.000s sys 0.000s
I20260807 13:40:41.820390 24547 leader_election.cc:288] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:41.828510 23881 consensus_queue.cc:260] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.829263 24544 leader_election.cc:288] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:41.827126 24456 leader_election.cc:288] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:41.830164 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:41.832329 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:41.835706 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.858361 23707 raft_consensus.cc:2454] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:41.835845 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:41.836540 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:41.784247 23705 raft_consensus.cc:2454] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:41.839617 23709 raft_consensus.cc:2379] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 2: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:41.840166 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.861512 23711 raft_consensus.cc:2379] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 2: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:41.840723 24543 raft_consensus.cc:482] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:41.840777 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:41.843482 24485 raft_consensus.cc:482] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:41.862637 24543 raft_consensus.cc:504] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.863231 24485 raft_consensus.cc:504] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.864439 23700 raft_consensus.cc:2454] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:41.865043 24543 leader_election.cc:288] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:41.848099 24496 raft_consensus.cc:729] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:41.853574 23703 raft_consensus.cc:1261] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:41.851361 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:41.868554 24496 consensus_queue.cc:260] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.869794 24496 raft_consensus.cc:3037] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:41.872498 24543 raft_consensus.cc:482] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:41.873088 24543 raft_consensus.cc:504] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.862078 23881 ts_tablet_manager.cc:1428] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.069s user 0.006s sys 0.002s
I20260807 13:40:41.895519 23881 tablet_bootstrap.cc:492] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:41.866469 24485 leader_election.cc:288] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:41.867161 23660 leader_election.cc:302] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:41.820144 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.879302 23884 tablet_bootstrap.cc:654] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:41.888047 23703 raft_consensus.cc:1226] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 1. Current term is 2. Ops: []
W20260807 13:40:41.568557 24519 consensus_queue.cc:1159] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d28e736aee9f4f01b013de670a762697" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260807 13:40:41.888164 23707 raft_consensus.cc:1261] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:41.893734 23705 raft_consensus.cc:1226] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:41.893946 23709 raft_consensus.cc:1226] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:41.899361 23888 tablet_bootstrap.cc:492] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:41.892072 23711 raft_consensus.cc:1226] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:41.887482 23704 raft_consensus.cc:1226] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:41.903008 24496 raft_consensus.cc:2726] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:41.903133 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:41.903980 23660 leader_election.cc:341] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:41.905946 23888 ts_tablet_manager.cc:1397] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.426s user 0.022s sys 0.006s
I20260807 13:40:41.906953 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.907531 24456 consensus_queue.cc:1046] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:41.912202 23660 leader_election.cc:302] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:41.914331 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.916026 24547 raft_consensus.cc:2781] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:41.916432 24547 raft_consensus.cc:482] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:41.916774 24547 raft_consensus.cc:3037] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:41.917317 23597 raft_consensus.cc:1261] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:41.915014 23703 raft_consensus.cc:2454] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 0.
I20260807 13:40:41.904328 23700 raft_consensus.cc:1226] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:41.905417 23699 raft_consensus.cc:2454] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:41.921402 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.923115 23711 raft_consensus.cc:2362] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2. Re-sending same reply.
I20260807 13:40:41.922827 23660 leader_election.cc:302] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:41.932900 23594 raft_consensus.cc:1261] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:41.933123 23599 raft_consensus.cc:1261] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:41.936026 23599 raft_consensus.cc:1261] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:41.936097 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.936741 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.937346 23711 raft_consensus.cc:2362] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2. Re-sending same reply.
I20260807 13:40:41.937464 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac6e18ecd14ba2a7d3e846a9fc81bf" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:41.938153 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.933022 23591 raft_consensus.cc:1261] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:41.938552 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.936966 23703 raft_consensus.cc:2379] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 2: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:41.939170 23699 raft_consensus.cc:2362] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2. Re-sending same reply.
I20260807 13:40:41.940073 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.941380 23711 raft_consensus.cc:2379] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 2: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:41.922323 24496 raft_consensus.cc:3032] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:41.921792 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c1184114b02410098331e68d3b8d4cf" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:41.941679 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.947096 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c1184114b02410098331e68d3b8d4cf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.952116 23711 raft_consensus.cc:2379] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 1: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
W20260807 13:40:41.922829 23535 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:40:41.947278 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:41.951056 23660 leader_election.cc:341] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:41.940081 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.954607 23600 raft_consensus.cc:2379] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 1: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:41.955163 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.955368 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.955622 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac6e18ecd14ba2a7d3e846a9fc81bf" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.959586 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.956429 23704 raft_consensus.cc:2379] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 2: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:41.948566 23710 raft_consensus.cc:2454] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:41.947767 24496 raft_consensus.cc:729] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
W20260807 13:40:41.961493 23662 leader_election.cc:341] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:41.969192 23662 leader_election.cc:302] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:41.970144 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.971920 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.973464 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.974227 23707 raft_consensus.cc:2454] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:41.975181 24514 raft_consensus.cc:2726] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:41.975405 23662 leader_election.cc:302] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:41.956761 24456 raft_consensus.cc:482] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:41.976169 24496 consensus_queue.cc:260] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.976555 23662 leader_election.cc:302] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:41.976451 24456 raft_consensus.cc:504] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:41.977370 24496 raft_consensus.cc:3037] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:41.979089 24462 raft_consensus.cc:2726] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:41.956836 24544 raft_consensus.cc:2781] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:41.980837 23662 leader_election.cc:302] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:41.981832 23662 leader_election.cc:302] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:41.979794 24462 raft_consensus.cc:2726] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:41.982931 24544 raft_consensus.cc:482] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:41.985968 24544 raft_consensus.cc:3037] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:41.960067 23699 raft_consensus.cc:2362] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2. Re-sending same reply.
I20260807 13:40:41.986783 23703 raft_consensus.cc:2454] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:41.995887 23884 tablet_bootstrap.cc:492] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:41.991302 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:41.997164 23700 raft_consensus.cc:2379] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 2: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:41.997040 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c1184114b02410098331e68d3b8d4cf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:41.997876 23704 raft_consensus.cc:2379] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 1: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:41.986543 24456 leader_election.cc:288] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:41.998580 23705 raft_consensus.cc:1261] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:41.996506 23884 ts_tablet_manager.cc:1397] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.219s user 0.009s sys 0.007s
I20260807 13:40:42.000941 23662 leader_election.cc:302] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.000985 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:42.001789 23711 raft_consensus.cc:2379] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 2: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:42.001850 23702 raft_consensus.cc:2454] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:42.002818 24529 raft_consensus.cc:2726] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:41.985013 24514 raft_consensus.cc:2726] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:42.011304 23881 tablet_bootstrap.cc:654] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:42.014461 23662 leader_election.cc:302] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.020270 23888 raft_consensus.cc:348] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.015460 23447 catalog_manager.cc:5495] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 0 to 1, leader changed from <none> to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 1 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:42.026914 23888 raft_consensus.cc:374] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:42.027417 23888 raft_consensus.cc:729] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:42.028555 23888 consensus_queue.cc:260] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.028126 24514 raft_consensus.cc:2726] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:40:42.034391 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 60278.8us
I20260807 13:40:42.036036 24491 consensus_queue.cc:1046] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:42.037101 24491 raft_consensus.cc:3032] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:42.037432 24491 raft_consensus.cc:729] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:42.038856 24543 leader_election.cc:288] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:42.040253 23710 raft_consensus.cc:1261] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:42.038282 24491 consensus_queue.cc:260] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.043227 24491 raft_consensus.cc:3037] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.044077 23597 raft_consensus.cc:2454] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:42.046553 23707 raft_consensus.cc:1261] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:42.054548 23884 raft_consensus.cc:348] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.055593 23884 raft_consensus.cc:374] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:42.055929 23884 raft_consensus.cc:729] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:42.056736 23884 consensus_queue.cc:260] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.062299 24576 raft_consensus.cc:482] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:41.999601 24547 raft_consensus.cc:504] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.063215 24576 raft_consensus.cc:504] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.071002 23769 leader_election.cc:302] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:42.074931 24502 raft_consensus.cc:2781] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:42.075433 24502 raft_consensus.cc:482] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:42.017379 24519 raft_consensus.cc:2726] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:42.075842 24502 raft_consensus.cc:3037] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.066510 24547 leader_election.cc:288] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:42.081319 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 78747.7us
I20260807 13:40:42.083441 23888 ts_tablet_manager.cc:1428] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.173s user 0.006s sys 0.001s
I20260807 13:40:42.083230 24554 consensus_queue.cc:1035] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:40:42.083911 23555 leader_election.cc:302] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.084478 23888 tablet_bootstrap.cc:492] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:42.084733 24485 raft_consensus.cc:2781] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260807 13:40:42.085119 23555 leader_election.cc:341] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:42.085124 24485 raft_consensus.cc:482] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:42.085668 24485 raft_consensus.cc:3037] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.085623 23555 leader_election.cc:302] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.087441 23555 leader_election.cc:302] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.088577 24554 raft_consensus.cc:2726] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:42.091825 24557 raft_consensus.cc:482] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:42.092494 24576 leader_election.cc:288] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:42.092363 24557 raft_consensus.cc:504] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.062538 24544 raft_consensus.cc:504] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.091827 23884 ts_tablet_manager.cc:1428] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.092s user 0.009s sys 0.000s
I20260807 13:40:42.093969 23769 leader_election.cc:302] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:42.093674 23709 raft_consensus.cc:1226] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:42.094412 24554 raft_consensus.cc:2781] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:42.094825 24554 raft_consensus.cc:482] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:42.095213 24554 raft_consensus.cc:3037] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.100492 24557 leader_election.cc:288] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:42.109615 24499 raft_consensus.cc:2726] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:42.112604 24558 consensus_queue.cc:1035] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:42.113371 23888 tablet_bootstrap.cc:654] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:42.112895 24486 consensus_queue.cc:1046] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:42.115213 24558 raft_consensus.cc:3032] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:42.115672 24558 raft_consensus.cc:729] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:42.110946 24491 consensus_queue.cc:1035] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260807 13:40:42.116613 24557 consensus_queue.cc:1046] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:42.116483 24558 consensus_queue.cc:260] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.118072 24486 raft_consensus.cc:3032] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:42.118456 24486 raft_consensus.cc:729] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:42.118616 24558 raft_consensus.cc:3037] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.119171 24557 consensus_queue.cc:1046] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:42.119419 24486 consensus_queue.cc:260] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.120586 24486 raft_consensus.cc:3037] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.121551 24579 consensus_queue.cc:1035] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:42.122907 24579 consensus_queue.cc:1035] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:42.118465 23555 leader_election.cc:302] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.116458 23884 tablet_bootstrap.cc:492] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:42.129977 24502 raft_consensus.cc:504] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.124913 24544 leader_election.cc:288] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:42.150079 23881 tablet_bootstrap.cc:492] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:42.150632 23881 ts_tablet_manager.cc:1397] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.255s user 0.028s sys 0.011s
I20260807 13:40:42.155041 24558 raft_consensus.cc:2781] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:42.155493 24558 raft_consensus.cc:482] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:42.155903 24558 raft_consensus.cc:3037] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:42.156821 23881 raft_consensus.cc:348] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.157552 23881 raft_consensus.cc:374] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:42.157814 23881 raft_consensus.cc:729] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:42.158813 24581 raft_consensus.cc:482] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:42.158493 23881 consensus_queue.cc:260] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.134315 24554 raft_consensus.cc:504] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:42.164633 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 45635.1us
I20260807 13:40:42.165669 23555 leader_election.cc:302] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.170635 23881 ts_tablet_manager.cc:1428] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.020s user 0.006s sys 0.000s
I20260807 13:40:42.172039 23881 tablet_bootstrap.cc:492] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:42.159039 24557 consensus_queue.cc:1046] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260807 13:40:42.169314 24485 raft_consensus.cc:504] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.176905 24485 leader_election.cc:288] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:42.177459 24485 consensus_queue.cc:1046] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:42.177714 24486 raft_consensus.cc:3032] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:42.178248 24486 raft_consensus.cc:729] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:42.178473 24485 raft_consensus.cc:3037] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.184731 24486 consensus_queue.cc:260] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.190627 24576 raft_consensus.cc:482] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:42.191221 24576 raft_consensus.cc:504] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.193768 24576 leader_election.cc:288] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:42.212970 23448 catalog_manager.cc:5495] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 1 to 2, leader changed from 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66) to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 2 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:42.168833 24502 leader_election.cc:288] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:42.161509 24581 raft_consensus.cc:504] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.224035 23448 catalog_manager.cc:5495] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 1 to 2, leader changed from 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66) to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 2 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:42.228977 23448 catalog_manager.cc:5495] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 1 to 2, leader changed from 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66) to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 2 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:42.232141 23555 leader_election.cc:302] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.238363 23769 leader_election.cc:302] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:42.238848 24486 raft_consensus.cc:3037] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.241554 24589 raft_consensus.cc:2726] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:42.232553 24587 raft_consensus.cc:3032] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:42.245220 23884 tablet_bootstrap.cc:654] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:42.246759 24491 raft_consensus.cc:2726] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:42.251152 24581 leader_election.cc:288] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:42.261086 23769 leader_election.cc:302] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:42.262907 24576 raft_consensus.cc:2781] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:42.263289 24576 raft_consensus.cc:482] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:42.263682 24576 raft_consensus.cc:3037] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.262553 23769 leader_election.cc:302] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:42.240836 23555 leader_election.cc:302] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.255456 24557 consensus_queue.cc:1046] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:42.255236 24587 raft_consensus.cc:729] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:42.259774 24554 leader_election.cc:288] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:42.267575 24587 consensus_queue.cc:260] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.254413 24558 raft_consensus.cc:504] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.269945 24587 raft_consensus.cc:3037] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.270040 24585 raft_consensus.cc:2726] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:42.271978 24557 raft_consensus.cc:3032] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:42.272315 24557 raft_consensus.cc:729] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:42.273149 23881 tablet_bootstrap.cc:654] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:42.275802 23555 leader_election.cc:302] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.278244 24586 raft_consensus.cc:3032] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:42.279772 24586 raft_consensus.cc:729] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:42.280759 24558 leader_election.cc:288] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:42.280570 24586 consensus_queue.cc:260] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.275331 24502 raft_consensus.cc:3037] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.281687 24557 consensus_queue.cc:260] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.279220 24486 raft_consensus.cc:2726] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:42.284682 24557 raft_consensus.cc:3037] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.291138 23769 leader_election.cc:302] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:42.292877 24579 raft_consensus.cc:3037] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.295189 23769 leader_election.cc:302] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:42.296365 23769 leader_election.cc:302] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:42.297139 24491 raft_consensus.cc:2781] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:42.297477 23769 leader_election.cc:302] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:42.297817 24584 raft_consensus.cc:3037] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.297674 24491 raft_consensus.cc:686] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:42.298262 24576 raft_consensus.cc:504] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.299124 24491 consensus_queue.cc:237] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.281715 24586 raft_consensus.cc:3037] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.300760 24499 raft_consensus.cc:2726] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:42.307971 23769 leader_election.cc:302] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:42.309072 23555 leader_election.cc:302] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.312214 24583 raft_consensus.cc:2781] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:42.312769 24583 raft_consensus.cc:686] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:42.309604 24587 consensus_queue.cc:1035] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260807 13:40:42.313690 24583 consensus_queue.cc:237] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.315546 24502 raft_consensus.cc:2726] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:42.321687 23555 leader_election.cc:302] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:42.322875 23555 leader_election.cc:302] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.321019 23769 leader_election.cc:302] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:42.325804 24558 raft_consensus.cc:2781] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:42.326213 24558 raft_consensus.cc:482] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:42.326563 24558 raft_consensus.cc:3037] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.327288 23888 tablet_bootstrap.cc:492] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:42.327768 23888 ts_tablet_manager.cc:1397] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.243s user 0.041s sys 0.030s
I20260807 13:40:42.324555 24486 raft_consensus.cc:2781] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:42.329586 24486 raft_consensus.cc:482] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:42.329991 24486 raft_consensus.cc:3037] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:42.331583 23888 raft_consensus.cc:348] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.332360 23888 raft_consensus.cc:374] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:42.332633 23888 raft_consensus.cc:729] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:42.333925 23888 consensus_queue.cc:260] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.334614 23555 leader_election.cc:302] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.320080 24587 raft_consensus.cc:2726] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:42.333848 24576 leader_election.cc:288] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:42.339605 23884 tablet_bootstrap.cc:492] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:42.348480 23884 ts_tablet_manager.cc:1397] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.238s user 0.011s sys 0.011s
I20260807 13:40:42.348637 24502 raft_consensus.cc:2781] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:42.346029 24485 raft_consensus.cc:2726] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:42.353888 23884 raft_consensus.cc:348] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.354532 24587 raft_consensus.cc:3037] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.354952 24581 raft_consensus.cc:482] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:42.356738 24581 raft_consensus.cc:504] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.348351 24584 raft_consensus.cc:2726] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:42.358806 24502 raft_consensus.cc:686] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:42.359853 24502 consensus_queue.cc:237] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.360414 23884 raft_consensus.cc:374] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:42.360895 23884 raft_consensus.cc:729] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:42.358887 24581 leader_election.cc:288] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:42.361927 23881 tablet_bootstrap.cc:492] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:42.361932 23884 consensus_queue.cc:260] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.362514 23881 ts_tablet_manager.cc:1397] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.191s user 0.011s sys 0.011s
I20260807 13:40:42.367607 24486 raft_consensus.cc:504] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.367940 24579 raft_consensus.cc:2726] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:42.369304 23888 ts_tablet_manager.cc:1428] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.041s user 0.007s sys 0.000s
I20260807 13:40:42.375322 23769 leader_election.cc:302] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:42.376201 24579 raft_consensus.cc:2781] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:42.376863 24579 raft_consensus.cc:686] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:42.378206 24544 raft_consensus.cc:482] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:42.377967 24579 consensus_queue.cc:237] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.379073 24544 raft_consensus.cc:504] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.381829 23884 ts_tablet_manager.cc:1428] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.033s user 0.004s sys 0.003s
I20260807 13:40:42.381961 24544 leader_election.cc:288] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:42.375880 23888 tablet_bootstrap.cc:492] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:42.384718 24558 raft_consensus.cc:504] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.383139 24486 leader_election.cc:288] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:42.393703 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 59160.3us
I20260807 13:40:42.378309 23769 leader_election.cc:302] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:42.400646 24558 leader_election.cc:288] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:42.408878 23555 leader_election.cc:302] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.391047 23884 tablet_bootstrap.cc:492] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:42.410488 23555 leader_election.cc:302] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.412606 24486 raft_consensus.cc:2726] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:40:42.417339 24557 raft_consensus.cc:3037] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.417615 24583 raft_consensus.cc:2726] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:42.422587 23447 catalog_manager.cc:5495] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 1 to 2, leader changed from 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66) to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 2 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:42.425706 23447 catalog_manager.cc:5495] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 0 to 1, leader changed from <none> to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 1 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:42.427163 24587 raft_consensus.cc:2726] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:42.431740 23769 leader_election.cc:302] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:42.435364 24583 raft_consensus.cc:2781] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:42.435756 24583 raft_consensus.cc:482] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:42.436098 24583 raft_consensus.cc:3037] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:42.441085 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:42.443913 23769 leader_election.cc:302] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:42.453634 24576 raft_consensus.cc:2781] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:42.443727 24583 raft_consensus.cc:504] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.444375 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:42.445571 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:42.454177 24576 raft_consensus.cc:482] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:42.455785 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:42.456650 23599 raft_consensus.cc:3037] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:42.458200 24583 leader_election.cc:288] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:42.446383 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c1184114b02410098331e68d3b8d4cf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:42.446054 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:42.450699 23881 raft_consensus.cc:348] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.454030 23769 leader_election.cc:302] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:42.456162 24576 raft_consensus.cc:3037] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.449261 24587 consensus_queue.cc:1046] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:42.461129 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:42.461470 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:42.472538 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:42.461161 23594 raft_consensus.cc:2379] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 1: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:42.462353 23769 leader_election.cc:302] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:42.479177 24579 raft_consensus.cc:3037] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.479508 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:42.462913 24583 raft_consensus.cc:3037] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.460577 23881 raft_consensus.cc:374] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:42.481184 23881 raft_consensus.cc:729] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:42.464761 24557 raft_consensus.cc:2726] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:42.482813 23888 tablet_bootstrap.cc:654] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:42.482980 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:42.483673 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:42.484369 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:42.486129 24544 raft_consensus.cc:482] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:42.487443 23769 leader_election.cc:302] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:42.489187 24558 raft_consensus.cc:3032] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:42.489717 23595 raft_consensus.cc:2454] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:42.492372 23591 raft_consensus.cc:2454] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:42.496896 24579 raft_consensus.cc:2726] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:42.500402 24576 raft_consensus.cc:504] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.501506 23600 raft_consensus.cc:2454] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:42.469772 23599 raft_consensus.cc:2454] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:42.504156 23597 raft_consensus.cc:2379] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 1: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:42.509953 24491 raft_consensus.cc:2781] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:42.510170 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:42.510551 24491 raft_consensus.cc:686] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:42.510885 23594 raft_consensus.cc:3037] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:42.511477 24491 consensus_queue.cc:237] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.504418 23881 consensus_queue.cc:260] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.507556 24544 raft_consensus.cc:504] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.504118 24558 raft_consensus.cc:729] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:42.515846 24558 consensus_queue.cc:260] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.516611 24544 leader_election.cc:288] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:42.517982 23769 leader_election.cc:302] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:42.519549 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:42.519596 24558 raft_consensus.cc:3037] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.526609 23447 catalog_manager.cc:5495] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 1 to 2, leader changed from 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66) to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 2 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:42.531862 23447 catalog_manager.cc:5495] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 1 to 2, leader changed from 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66) to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 2 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:42.535084 24583 raft_consensus.cc:2726] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:42.529103 23594 raft_consensus.cc:2454] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:42.543699 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac6e18ecd14ba2a7d3e846a9fc81bf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:42.544905 23600 raft_consensus.cc:2454] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:42.551460 24576 leader_election.cc:288] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:42.557468 23662 leader_election.cc:302] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.561856 23662 leader_election.cc:302] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:42.560323 23772 leader_election.cc:302] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:42.563141 23662 leader_election.cc:302] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:42.562799 24579 consensus_queue.cc:1035] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260807 13:40:42.562956 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:42.564690 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "830e8cb8ce434e6391c09530c677a61d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:42.570884 23598 raft_consensus.cc:2454] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:42.552567 24502 raft_consensus.cc:2781] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:42.564939 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:42.567947 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:42.572502 23703 raft_consensus.cc:2379] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 2: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:42.574232 23711 raft_consensus.cc:2379] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 2: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:42.564621 23662 leader_election.cc:302] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.576049 23662 leader_election.cc:302] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.579021 23881 ts_tablet_manager.cc:1428] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.216s user 0.009s sys 0.000s
I20260807 13:40:42.579134 23769 leader_election.cc:302] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:42.568629 23709 raft_consensus.cc:2454] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:42.567034 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:42.580855 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:42.567788 24547 raft_consensus.cc:2781] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:42.582643 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:42.582732 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "830e8cb8ce434e6391c09530c677a61d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:42.583211 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:42.568747 23705 raft_consensus.cc:1226] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260807 13:40:42.584040 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:42.584599 23704 raft_consensus.cc:3037] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:42.584715 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:42.585338 23705 raft_consensus.cc:3037] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:42.582710 23703 raft_consensus.cc:3037] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.580928 24496 raft_consensus.cc:2781] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:42.586405 23702 raft_consensus.cc:2379] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 2: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:42.573676 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:42.587347 23710 raft_consensus.cc:2379] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 2: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:42.587131 24584 consensus_queue.cc:1035] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:42.587572 23702 raft_consensus.cc:1226] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:42.583557 23597 raft_consensus.cc:2379] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 1: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:42.564352 24519 raft_consensus.cc:2781] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:42.563527 24544 raft_consensus.cc:2726] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:42.594635 23703 raft_consensus.cc:2454] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:42.596210 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:42.596982 23711 raft_consensus.cc:3037] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.573442 24491 raft_consensus.cc:2781] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:42.595391 24584 raft_consensus.cc:2726] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:42.561321 24499 consensus_queue.cc:1035] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260807 13:40:42.599172 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:42.599777 23769 leader_election.cc:302] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:42.600672 24499 raft_consensus.cc:2781] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:42.601053 23769 leader_election.cc:302] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:42.601069 24499 raft_consensus.cc:482] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:42.567360 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:42.601670 24499 raft_consensus.cc:3037] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.601989 23884 tablet_bootstrap.cc:654] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:42.602267 23699 raft_consensus.cc:2379] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 2: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:42.588958 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:42.602996 23709 raft_consensus.cc:2454] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:42.603080 24544 raft_consensus.cc:2781] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:42.603684 23881 tablet_bootstrap.cc:492] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:42.603621 24544 raft_consensus.cc:686] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:42.604552 24544 consensus_queue.cc:237] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.603093 24583 consensus_queue.cc:1035] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260807 13:40:42.607038 24584 raft_consensus.cc:3037] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.607184 24557 raft_consensus.cc:482] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:42.565461 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f8a5f186bf1473a988921e5efa3e574" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:42.608072 23769 leader_election.cc:302] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
W20260807 13:40:42.630420 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 54495.9us
I20260807 13:40:42.635221 23711 raft_consensus.cc:2454] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:42.597510 24502 raft_consensus.cc:686] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
W20260807 13:40:42.641171 23769 leader_election.cc:341] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:42.622843 24491 raft_consensus.cc:482] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:42.628480 24496 raft_consensus.cc:686] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:42.630858 24547 raft_consensus.cc:686] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:42.652151 23769 leader_election.cc:302] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:42.636896 24576 raft_consensus.cc:2726] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:42.655465 23769 leader_election.cc:302] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:42.625896 24557 raft_consensus.cc:504] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.642472 24491 raft_consensus.cc:3037] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:42.659008 24519 raft_consensus.cc:686] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:42.662603 24576 raft_consensus.cc:3037] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.671494 24557 leader_election.cc:288] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:42.672540 24499 raft_consensus.cc:504] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.672744 24496 consensus_queue.cc:237] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.674906 24502 consensus_queue.cc:237] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.659240 24574 raft_consensus.cc:2781] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:42.685245 23597 raft_consensus.cc:1226] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:42.687727 24547 consensus_queue.cc:237] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.692926 24574 raft_consensus.cc:686] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:42.698764 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:42.699584 23599 raft_consensus.cc:2379] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 1: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:42.691457 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:42.684701 24584 raft_consensus.cc:2726] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:42.699698 24574 consensus_queue.cc:237] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.707219 23707 raft_consensus.cc:2379] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 2: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:42.687651 24519 consensus_queue.cc:237] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.715826 24579 consensus_queue.cc:1035] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260807 13:40:42.725020 23881 tablet_bootstrap.cc:654] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:42.717099 23705 raft_consensus.cc:2454] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:42.733000 23704 raft_consensus.cc:2454] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:42.733844 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:42.712914 24499 leader_election.cc:288] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:42.745606 23555 leader_election.cc:302] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.746140 23772 leader_election.cc:302] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:42.751784 23555 leader_election.cc:302] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.755875 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:42.761437 23820 raft_consensus.cc:1226] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:42.761637 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:42.762230 23823 raft_consensus.cc:1226] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 1. Current term is 2. Ops: []
W20260807 13:40:42.762493 24603 log.cc:924] Time spent T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.074s user 0.000s sys 0.001s
I20260807 13:40:42.763402 23704 raft_consensus.cc:2379] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 2: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:42.763929 23815 raft_consensus.cc:1226] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:42.717257 24583 consensus_queue.cc:1035] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260807 13:40:42.765179 23823 raft_consensus.cc:1226] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:42.756289 24558 raft_consensus.cc:2781] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:42.750506 24557 raft_consensus.cc:2726] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:40:42.768862 23555 leader_election.cc:341] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:42.769913 23555 leader_election.cc:302] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.752372 24499 raft_consensus.cc:2781] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:42.771956 24499 raft_consensus.cc:482] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:42.772009 23812 raft_consensus.cc:1226] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:42.772387 24584 consensus_queue.cc:1035] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:42.772964 23813 raft_consensus.cc:1226] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260807 13:40:42.773600 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:42.774158 24558 raft_consensus.cc:482] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:42.774395 23818 raft_consensus.cc:2379] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 2: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:42.774643 24558 raft_consensus.cc:3037] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.775529 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:42.773144 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:42.775146 24587 consensus_queue.cc:1046] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260807 13:40:42.777845 24587 raft_consensus.cc:3032] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:42.778174 24587 raft_consensus.cc:729] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:42.778981 24587 consensus_queue.cc:260] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.780387 24587 raft_consensus.cc:3037] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.785974 23823 raft_consensus.cc:2454] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:42.789851 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:42.778904 23588 raft_consensus.cc:2454] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:42.791304 23825 raft_consensus.cc:1226] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:42.753177 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:42.793015 23823 raft_consensus.cc:3037] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:42.820740 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "830e8cb8ce434e6391c09530c677a61d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:42.824451 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 54594.2us
I20260807 13:40:42.772408 24499 raft_consensus.cc:3037] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:42.825551 23555 leader_election.cc:302] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.837716 23660 leader_election.cc:302] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.836896 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:42.839860 24544 raft_consensus.cc:2726] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:42.828084 24557 raft_consensus.cc:3037] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.841741 23660 leader_election.cc:302] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.844524 23823 raft_consensus.cc:2454] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:42.826617 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:42.857693 23888 tablet_bootstrap.cc:492] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:42.858283 23888 ts_tablet_manager.cc:1397] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.487s user 0.009s sys 0.027s
I20260807 13:40:42.859346 23660 leader_election.cc:302] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.860347 24544 raft_consensus.cc:2726] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:42.863427 23555 leader_election.cc:302] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:42.845755 23595 raft_consensus.cc:2379] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 2: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
W20260807 13:40:42.864439 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 233094us
I20260807 13:40:42.845659 24486 raft_consensus.cc:3037] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:42.867689 23660 leader_election.cc:302] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.869866 23660 leader_election.cc:302] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.865163 23555 leader_election.cc:302] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:42.875083 24586 raft_consensus.cc:2781] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:42.875586 24586 raft_consensus.cc:482] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:42.875967 24586 raft_consensus.cc:3037] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:42.845965 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:42.882431 23660 leader_election.cc:302] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.884831 24608 raft_consensus.cc:2726] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:42.868707 24581 raft_consensus.cc:2781] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:42.868309 24544 raft_consensus.cc:2726] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:42.887120 23662 leader_election.cc:302] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:42.841760 24491 raft_consensus.cc:504] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.886484 24496 raft_consensus.cc:2726] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:42.864675 24485 consensus_queue.cc:1046] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260807 13:40:42.883162 24547 raft_consensus.cc:2726] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:40:42.891371 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 143026us
I20260807 13:40:42.899212 23815 raft_consensus.cc:1226] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:42.909682 23662 leader_election.cc:302] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:42.899376 23881 tablet_bootstrap.cc:492] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:42.902344 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:42.903201 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:42.904368 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:42.907464 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "830e8cb8ce434e6391c09530c677a61d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:42.919641 23884 tablet_bootstrap.cc:492] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:42.905233 23448 catalog_manager.cc:5495] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 1 to 2, leader changed from 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66) to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 2 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:42.911309 23881 ts_tablet_manager.cc:1397] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 0.308s user 0.013s sys 0.017s
I20260807 13:40:42.920218 23884 ts_tablet_manager.cc:1397] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.538s user 0.011s sys 0.012s
W20260807 13:40:42.911602 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 46498.8us
I20260807 13:40:42.920954 23555 leader_election.cc:302] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:42.922165 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:42.905439 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
W20260807 13:40:42.927911 23662 leader_election.cc:341] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:42.920969 23448 catalog_manager.cc:5495] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 1 to 2, leader changed from 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66) to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 2 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:42.929734 23448 catalog_manager.cc:5495] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 1 to 2, leader changed from 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66) to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 2 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:42.933666 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:42.939265 24634 consensus_queue.cc:1046] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:42.941045 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:42.925977 24519 raft_consensus.cc:2781] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:42.927783 24496 raft_consensus.cc:2781] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:42.956197 23660 leader_election.cc:302] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.967512 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:42.936645 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:42.955780 23710 raft_consensus.cc:2379] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 2: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:42.926826 23700 raft_consensus.cc:2362] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2. Re-sending same reply.
I20260807 13:40:42.948884 24547 raft_consensus.cc:482] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:42.981549 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:42.941217 23705 raft_consensus.cc:2362] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2. Re-sending same reply.
I20260807 13:40:42.983060 23711 raft_consensus.cc:2379] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 1: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:42.936892 23704 raft_consensus.cc:2362] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2. Re-sending same reply.
I20260807 13:40:42.989722 23817 raft_consensus.cc:2379] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 1: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:42.990450 24608 raft_consensus.cc:482] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:42.990687 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f8a5f186bf1473a988921e5efa3e574" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:42.991053 24608 raft_consensus.cc:504] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:42.992076 24621 log.cc:924] Time spent T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.084s user 0.000s sys 0.000s
I20260807 13:40:42.993620 24586 raft_consensus.cc:504] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:42.980741 24612 log.cc:924] Time spent T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.185s user 0.000s sys 0.001s
I20260807 13:40:42.995133 24608 leader_election.cc:288] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:42.994972 23884 raft_consensus.cc:348] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.995730 23884 raft_consensus.cc:374] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:42.996002 23884 raft_consensus.cc:729] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
W20260807 13:40:42.997049 24615 log.cc:924] Time spent T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.133s user 0.000s sys 0.000s
I20260807 13:40:42.996752 23888 raft_consensus.cc:348] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.997615 23888 raft_consensus.cc:374] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:42.997937 23888 raft_consensus.cc:729] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:42.987541 24547 raft_consensus.cc:504] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:42.974982 24611 raft_consensus.cc:482] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
W20260807 13:40:42.999958 24626 log.cc:924] Time spent T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.090s user 0.000s sys 0.000s
I20260807 13:40:43.000051 24547 leader_election.cc:288] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:42.994387 23660 leader_election.cc:341] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:43.001547 23660 leader_election.cc:302] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.965029 24519 raft_consensus.cc:482] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:42.975207 24544 raft_consensus.cc:482] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
W20260807 13:40:43.009205 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 103137us
W20260807 13:40:43.022852 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 101972us
I20260807 13:40:42.980274 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:43.006511 23884 consensus_queue.cc:260] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.004312 24608 raft_consensus.cc:2726] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:43.004462 24519 raft_consensus.cc:3037] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:43.023703 23555 leader_election.cc:302] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:43.024742 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:43.036312 23823 raft_consensus.cc:2379] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 1: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:43.037572 23660 leader_election.cc:302] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:42.982173 23707 raft_consensus.cc:2362] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2. Re-sending same reply.
I20260807 13:40:42.984833 24605 raft_consensus.cc:2726] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:43.040850 23881 raft_consensus.cc:348] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.054085 23881 raft_consensus.cc:374] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:43.046478 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:43.044126 24547 raft_consensus.cc:2726] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:43.054144 24586 leader_election.cc:288] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:43.048375 24625 log.cc:924] Time spent T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.156s user 0.001s sys 0.000s
I20260807 13:40:43.046978 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:43.046340 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:43.048988 24629 log.cc:924] Time spent T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.079s user 0.000s sys 0.000s
I20260807 13:40:43.050191 24486 raft_consensus.cc:2726] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:43.065819 24486 raft_consensus.cc:2781] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:43.066321 24486 raft_consensus.cc:686] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:43.058837 23812 raft_consensus.cc:2379] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 2: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:43.060088 24491 leader_election.cc:288] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:43.047066 23884 ts_tablet_manager.cc:1428] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.127s user 0.009s sys 0.000s
I20260807 13:40:43.070212 23884 tablet_bootstrap.cc:492] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:42.999003 24611 raft_consensus.cc:504] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.072196 24611 leader_election.cc:288] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:43.061403 23881 raft_consensus.cc:729] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:43.073015 23660 leader_election.cc:302] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:43.034721 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac6e18ecd14ba2a7d3e846a9fc81bf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:43.073374 23881 consensus_queue.cc:260] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.029145 24544 raft_consensus.cc:504] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.061945 24576 raft_consensus.cc:2726] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:43.078047 24547 raft_consensus.cc:2726] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:43.078728 23707 raft_consensus.cc:1226] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:43.080075 23815 raft_consensus.cc:2379] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 1: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:43.080575 24544 leader_election.cc:288] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:43.081158 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:43.003141 23888 consensus_queue.cc:260] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.092563 23888 ts_tablet_manager.cc:1428] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.234s user 0.008s sys 0.000s
I20260807 13:40:43.093880 23888 tablet_bootstrap.cc:492] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:40:43.096428 24499 raft_consensus.cc:504] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.098069 23820 raft_consensus.cc:2379] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 1: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
W20260807 13:40:43.128167 23535 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:40:43.135005 24499 leader_election.cc:288] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:40:43.144085 23769 leader_election.cc:341] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:42.994292 24558 raft_consensus.cc:504] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.153862 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac6e18ecd14ba2a7d3e846a9fc81bf" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:43.157002 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:43.161278 23881 ts_tablet_manager.cc:1428] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.241s user 0.005s sys 0.004s
I20260807 13:40:43.165592 23888 tablet_bootstrap.cc:654] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:43.168457 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "830e8cb8ce434e6391c09530c677a61d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:43.171797 23769 leader_election.cc:302] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:43.174129 23769 leader_election.cc:302] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:43.179989 23884 tablet_bootstrap.cc:654] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:43.049019 24587 consensus_queue.cc:1046] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.110s
I20260807 13:40:43.183231 23881 tablet_bootstrap.cc:492] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:43.074558 24486 consensus_queue.cc:237] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.158349 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:43.200259 23769 leader_election.cc:302] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:43.197099 24587 consensus_queue.cc:1046] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260807 13:40:43.195241 24491 raft_consensus.cc:2726] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:43.181656 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:43.224614 24620 raft_consensus.cc:2781] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:43.220685 24579 raft_consensus.cc:2726] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:43.207239 24634 raft_consensus.cc:2726] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:43.225683 24635 raft_consensus.cc:3032] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:43.237712 24635 raft_consensus.cc:729] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:43.238873 24635 consensus_queue.cc:260] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.240528 24635 raft_consensus.cc:3037] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:43.225302 23769 leader_election.cc:302] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:43.242946 23704 raft_consensus.cc:2379] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 2: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:43.245522 23704 raft_consensus.cc:1261] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:43.233939 24620 raft_consensus.cc:686] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:43.251914 24544 raft_consensus.cc:482] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:43.252530 24544 raft_consensus.cc:504] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.254423 24557 raft_consensus.cc:2726] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:43.255481 24576 raft_consensus.cc:3037] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:43.255995 24558 leader_election.cc:288] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:43.259812 23769 leader_election.cc:302] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:43.265023 24519 raft_consensus.cc:504] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.266685 23702 raft_consensus.cc:2379] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 1: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:43.269279 23704 raft_consensus.cc:1226] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:43.269236 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:43.271224 24641 raft_consensus.cc:3032] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:43.271729 24641 raft_consensus.cc:729] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:43.272694 24641 consensus_queue.cc:260] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.273298 23704 raft_consensus.cc:1261] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:43.276968 24499 raft_consensus.cc:2781] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:43.278968 24499 raft_consensus.cc:686] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:43.281534 23705 raft_consensus.cc:1226] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 2. Current term is 3. Ops: []
W20260807 13:40:43.290896 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 314660us
I20260807 13:40:43.280668 24499 consensus_queue.cc:237] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.248966 24620 consensus_queue.cc:237] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
I20260807 13:40:43.275566 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:43.318189 24632 consensus_queue.cc:1046] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:43.319868 24632 raft_consensus.cc:3032] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:43.320216 24632 raft_consensus.cc:729] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:43.318581 24610 raft_consensus.cc:482] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:43.304949 24544 leader_election.cc:288] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:43.320987 24632 consensus_queue.cc:260] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.321270 24586 raft_consensus.cc:3032] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:43.328177 24519 leader_election.cc:288] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:43.350222 23769 leader_election.cc:341] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:43.331671 24586 raft_consensus.cc:729] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:43.344830 24632 raft_consensus.cc:3037] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:43.324072 24610 raft_consensus.cc:504] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:43.374691 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 52826.3us
I20260807 13:40:43.364130 24581 raft_consensus.cc:686] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:43.372255 23704 raft_consensus.cc:1261] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:43.372972 24544 raft_consensus.cc:482] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:40:43.384482 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 361750us
I20260807 13:40:43.389438 23554 leader_election.cc:302] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
W20260807 13:40:43.394519 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 370878us
I20260807 13:40:43.397390 23555 leader_election.cc:302] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:43.398355 23555 leader_election.cc:302] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:43.401357 23554 leader_election.cc:302] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:43.377254 24496 raft_consensus.cc:686] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:43.402251 24558 raft_consensus.cc:2781] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:43.388401 24644 consensus_queue.cc:1046] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260807 13:40:43.397529 24634 raft_consensus.cc:3037] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:43.413388 23662 leader_election.cc:302] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:43.417734 24649 raft_consensus.cc:2781] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:43.402621 24557 raft_consensus.cc:2781] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:43.418462 24638 consensus_queue.cc:1035] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260807 13:40:43.418758 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:43.393985 24485 consensus_queue.cc:1046] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260807 13:40:43.392330 24574 consensus_queue.cc:1035] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260807 13:40:43.422569 23554 leader_election.cc:302] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:43.389160 24544 raft_consensus.cc:504] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.387111 24586 consensus_queue.cc:260] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.420094 24558 raft_consensus.cc:686] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:43.440117 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:43.439958 24496 consensus_queue.cc:237] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.443292 24648 raft_consensus.cc:2781] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:43.444119 24648 raft_consensus.cc:686] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:43.426290 24649 raft_consensus.cc:686] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:43.457042 23881 tablet_bootstrap.cc:654] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:43.410455 24581 consensus_queue.cc:237] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.478823 24650 raft_consensus.cc:3032] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:43.479339 24650 raft_consensus.cc:729] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:43.480226 24650 consensus_queue.cc:260] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.482781 24650 raft_consensus.cc:3037] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:43.449522 24648 consensus_queue.cc:237] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.500016 24642 raft_consensus.cc:3037] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:43.496403 23448 catalog_manager.cc:5495] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 1 to 2, leader changed from 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65) to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 2 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:43.504455 23448 catalog_manager.cc:5495] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 1 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:43.506561 23448 catalog_manager.cc:5495] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 1 to 2, leader changed from 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65) to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 2 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:43.508883 23448 catalog_manager.cc:5495] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 1 to 2, leader changed from 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65) to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 2 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:43.498622 24641 raft_consensus.cc:3037] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:43.548173 24623 raft_consensus.cc:482] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:43.495574 24610 leader_election.cc:288] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:43.519203 24519 raft_consensus.cc:482] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:43.500774 24558 consensus_queue.cc:237] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.565018 24623 raft_consensus.cc:504] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.627100 24586 raft_consensus.cc:3037] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:43.563520 24611 raft_consensus.cc:482] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:43.640288 24610 raft_consensus.cc:482] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:43.643419 24605 raft_consensus.cc:482] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:43.644573 24576 raft_consensus.cc:2726] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:43.645341 24605 raft_consensus.cc:504] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.628566 24623 leader_election.cc:288] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:43.645126 24610 raft_consensus.cc:504] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
I20260807 13:40:43.642643 24544 leader_election.cc:288] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:43.581593 24519 raft_consensus.cc:504] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.666033 23702 raft_consensus.cc:2454] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:43.644215 24611 raft_consensus.cc:504] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.709345 24610 leader_election.cc:288] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685), 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187)
I20260807 13:40:43.563159 24649 consensus_queue.cc:237] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:43.721810 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 339836us
I20260807 13:40:43.719717 24610 raft_consensus.cc:482] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:43.750926 23884 tablet_bootstrap.cc:492] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:43.751621 23884 ts_tablet_manager.cc:1397] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 0.682s user 0.016s sys 0.041s
I20260807 13:40:43.766527 23769 leader_election.cc:302] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:43.775731 24502 raft_consensus.cc:2726] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:43.760896 24519 leader_election.cc:288] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:43.752421 24544 raft_consensus.cc:482] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:43.784981 24544 raft_consensus.cc:504] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.784401 24623 raft_consensus.cc:482] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:43.808239 24623 raft_consensus.cc:504] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.813094 24519 raft_consensus.cc:482] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:43.815029 23888 tablet_bootstrap.cc:492] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:43.815526 23888 ts_tablet_manager.cc:1397] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.722s user 0.024s sys 0.004s
I20260807 13:40:43.771258 24634 raft_consensus.cc:2726] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:43.807688 24642 raft_consensus.cc:2726] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:43.769599 24583 consensus_queue.cc:1035] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260807 13:40:43.766666 24610 raft_consensus.cc:504] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.823836 24650 consensus_queue.cc:1035] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260807 13:40:43.831238 24643 raft_consensus.cc:482] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:43.831861 24643 raft_consensus.cc:504] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.786209 24574 consensus_queue.cc:1046] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260807 13:40:43.837853 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:43.850039 23820 raft_consensus.cc:1261] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:43.827337 24623 leader_election.cc:288] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:43.813583 24519 raft_consensus.cc:504] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.856492 23888 raft_consensus.cc:348] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.861155 23888 raft_consensus.cc:374] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:43.861527 23888 raft_consensus.cc:729] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:40:43.862293 23888 consensus_queue.cc:260] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.839104 23821 raft_consensus.cc:3037] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:43.846916 23818 raft_consensus.cc:3037] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:43.869521 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:43.837548 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9552d42b445450691daef21fba4059a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:43.855542 24611 leader_election.cc:288] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:43.850135 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:43.839411 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:43.874289 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:43.876663 23888 ts_tablet_manager.cc:1428] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.061s user 0.007s sys 0.000s
I20260807 13:40:43.877115 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:43.882764 23825 raft_consensus.cc:2454] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:43.883097 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:43.834640 24643 leader_election.cc:288] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:43.844101 24605 leader_election.cc:288] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:43.870589 24557 raft_consensus.cc:686] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:43.883460 23815 raft_consensus.cc:1261] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:43.889966 23888 tablet_bootstrap.cc:492] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
W20260807 13:40:43.890815 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 468293us
I20260807 13:40:43.889997 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac6e18ecd14ba2a7d3e846a9fc81bf" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:43.891774 23600 raft_consensus.cc:3037] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:43.892249 23554 leader_election.cc:302] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:43.897120 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "830e8cb8ce434e6391c09530c677a61d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:43.906327 23597 raft_consensus.cc:1261] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:43.907980 23598 raft_consensus.cc:1261] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:43.910382 24643 raft_consensus.cc:482] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:43.913956 24643 raft_consensus.cc:504] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:43.914186 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:43.915004 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:43.915580 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:43.916002 24643 leader_election.cc:288] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:43.916216 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac6e18ecd14ba2a7d3e846a9fc81bf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:43.923131 23588 raft_consensus.cc:1226] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:43.911317 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:43.891530 24544 leader_election.cc:288] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:43.933506 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:43.933938 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:43.934321 23815 raft_consensus.cc:2454] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:43.934515 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:43.934764 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:43.935252 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:43.935889 23820 raft_consensus.cc:2454] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:43.930305 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:43.937022 23598 raft_consensus.cc:2454] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:43.935391 23823 raft_consensus.cc:2454] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:43.937901 23821 raft_consensus.cc:1261] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:43.938862 24587 raft_consensus.cc:3032] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:43.939231 24587 raft_consensus.cc:729] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:43.939504 23590 raft_consensus.cc:1261] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:43.939219 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:43.940287 23601 raft_consensus.cc:1261] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:43.940462 23588 raft_consensus.cc:2454] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:43.938297 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac6e18ecd14ba2a7d3e846a9fc81bf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:43.938877 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9552d42b445450691daef21fba4059a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:43.905246 24641 raft_consensus.cc:3037] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:43.944572 23598 raft_consensus.cc:2454] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:43.929167 23600 raft_consensus.cc:2454] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:43.942538 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:43.945571 23597 raft_consensus.cc:2454] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
W20260807 13:40:43.900576 23774 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.505s user 0.006s sys 0.043s
I20260807 13:40:43.924878 24519 leader_election.cc:288] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:43.945525 24654 log.cc:924] Time spent T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.174s user 0.000s sys 0.002s
I20260807 13:40:43.941286 24642 raft_consensus.cc:482] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:43.987140 23769 leader_election.cc:302] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:43.950927 24485 raft_consensus.cc:482] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:43.993378 23660 leader_election.cc:302] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:43.967455 23591 raft_consensus.cc:1261] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:43.961949 24635 raft_consensus.cc:482] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:44.005299 24653 raft_consensus.cc:3032] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:44.006021 24651 raft_consensus.cc:482] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:40:44.008695 23660 leader_election.cc:341] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:40:44.048280 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:44.008030 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:44.007508 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:44.079087 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
W20260807 13:40:44.078047 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 69406.8us
I20260807 13:40:43.964326 24547 consensus_queue.cc:1035] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260807 13:40:44.000797 23825 raft_consensus.cc:2396] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 13:40:44.003417 23814 raft_consensus.cc:2379] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 1: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:44.121287 23660 leader_election.cc:302] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:44.075947 23884 raft_consensus.cc:348] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.140861 23884 raft_consensus.cc:374] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:44.141244 23884 raft_consensus.cc:729] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:44.142021 23884 consensus_queue.cc:260] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.122526 23600 raft_consensus.cc:2454] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:43.999749 23702 raft_consensus.cc:1261] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:44.007509 24648 raft_consensus.cc:2781] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:43.978338 24557 consensus_queue.cc:237] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.048867 24610 leader_election.cc:288] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:44.157097 23820 raft_consensus.cc:2379] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 2: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:44.191932 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 436) took 1076 ms. Trace:
W20260807 13:40:44.188630 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 67403.8us
I20260807 13:40:44.192749 23660 leader_election.cc:302] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:44.126875 24519 raft_consensus.cc:482] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:44.205734 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:44.192373 23703 rpcz_store.cc:276] 0807 13:40:43.084793 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:43.084907 (+ 114us) service_pool.cc:227] Handling call
0807 13:40:43.153059 (+ 68152us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:43.162053 (+ 8994us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:43.162097 (+ 44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:43.202293 (+ 40196us) spinlock_profiling.cc:243] Waited 3.51 ms on lock 0x7b2c00005cf8. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461aa90e11 00007f461aaa0442 00007f461c0e8c11 00007f461c0ad58a 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772
0807 13:40:43.202681 (+ 388us) log.cc:842] Serialized 26 byte log entry
0807 13:40:43.514258 (+311577us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:43.514312 (+ 54us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:43.514413 (+ 101us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:44.158887 (+644474us) raft_consensus.cc:1671] finished
0807 13:40:44.158910 (+ 23us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:44.161197 (+ 2287us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3270,"raft.queue_time_us":8984,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":19211,"spinlock_wait_cycles":8066432,"thread_start_us":311202,"threads_started":1,"wal-append.queue_time_us":564339}
I20260807 13:40:44.126462 24639 raft_consensus.cc:482] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:44.215711 23884 ts_tablet_manager.cc:1428] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.464s user 0.011s sys 0.000s
I20260807 13:40:44.157996 24648 raft_consensus.cc:482] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:44.212402 23660 leader_election.cc:302] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:44.130209 24653 raft_consensus.cc:729] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
W20260807 13:40:44.201591 24658 log.cc:924] Time spent T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.064s user 0.000s sys 0.000s
I20260807 13:40:44.188844 24611 raft_consensus.cc:482] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:44.198158 24502 raft_consensus.cc:2726] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:40:44.080200 24642 raft_consensus.cc:504] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.207895 24610 raft_consensus.cc:482] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:44.007696 24485 raft_consensus.cc:504] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
I20260807 13:40:44.200793 24643 raft_consensus.cc:2781] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:44.206527 23600 raft_consensus.cc:2454] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:44.122617 24635 raft_consensus.cc:504] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.203713 23815 raft_consensus.cc:1226] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:44.230852 24648 raft_consensus.cc:3037] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:44.152108 24544 consensus_queue.cc:1035] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.097s
I20260807 13:40:44.248953 24666 raft_consensus.cc:482] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:44.221081 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:44.222069 24558 raft_consensus.cc:482] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:44.217125 24608 raft_consensus.cc:2781] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:44.231457 24586 raft_consensus.cc:482] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:44.255904 23597 raft_consensus.cc:2454] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:44.240154 24496 raft_consensus.cc:2781] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:44.266209 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:44.241904 24605 raft_consensus.cc:482] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:44.272248 23600 raft_consensus.cc:2454] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:44.234725 24678 raft_consensus.cc:482] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:44.269330 23884 tablet_bootstrap.cc:492] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:40:44.241626 24676 raft_consensus.cc:482] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:44.255926 24581 raft_consensus.cc:482] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:44.276712 23881 tablet_bootstrap.cc:492] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:44.316923 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:44.319098 23881 ts_tablet_manager.cc:1397] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 1.136s user 0.031s sys 0.013s
I20260807 13:40:44.242930 24643 raft_consensus.cc:482] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:44.213862 24519 raft_consensus.cc:504] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.233603 24610 raft_consensus.cc:504] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.153726 24587 consensus_queue.cc:260] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.320242 24643 raft_consensus.cc:3037] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:44.321074 24587 raft_consensus.cc:3037] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:44.321872 24610 leader_election.cc:288] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:44.245590 24632 consensus_meta.cc:287] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.867s user 0.014s sys 0.000s
I20260807 13:40:44.306221 24547 raft_consensus.cc:482] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:44.279395 24496 raft_consensus.cc:482] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:44.271010 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:44.324136 24547 raft_consensus.cc:504] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.271010 24608 raft_consensus.cc:482] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:44.313886 24649 raft_consensus.cc:482] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:44.239804 24611 raft_consensus.cc:504] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.233603 24653 consensus_queue.cc:260] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.267356 24634 raft_consensus.cc:482] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:44.139853 24651 raft_consensus.cc:504] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.343454 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:44.278291 24586 raft_consensus.cc:504] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.304678 23588 raft_consensus.cc:2454] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:44.351095 23601 raft_consensus.cc:2396] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 13:40:44.359212 23598 raft_consensus.cc:2454] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:44.222183 24639 raft_consensus.cc:504] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.330608 24496 raft_consensus.cc:3037] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:44.342329 24608 raft_consensus.cc:3037] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:44.307524 24544 consensus_queue.cc:1035] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260807 13:40:44.314527 24605 raft_consensus.cc:504] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.387908 23881 raft_consensus.cc:348] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.388825 23881 raft_consensus.cc:374] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260807 13:40:44.376824 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 389714us
I20260807 13:40:44.331422 24558 raft_consensus.cc:504] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.334872 24581 raft_consensus.cc:504] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.389154 23881 raft_consensus.cc:729] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:44.396229 24667 raft_consensus.cc:482] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:44.414770 23881 consensus_queue.cc:260] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.355049 24634 raft_consensus.cc:504] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.346413 24649 raft_consensus.cc:504] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.366608 24639 leader_election.cc:288] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:44.366941 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:44.386966 24642 leader_election.cc:288] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:44.422008 24674 consensus_queue.cc:1035] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260807 13:40:44.423216 24637 raft_consensus.cc:482] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:44.315629 24666 raft_consensus.cc:504] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:44.423884 24669 log.cc:924] Time spent T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.280s user 0.001s sys 0.000s
I20260807 13:40:44.420286 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:44.427080 24687 log.cc:924] Time spent T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.140s user 0.000s sys 0.001s
I20260807 13:40:44.390451 24653 raft_consensus.cc:3037] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:44.418255 24638 raft_consensus.cc:482] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:44.420172 24499 raft_consensus.cc:482] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:44.420428 24519 leader_election.cc:288] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:44.434211 23702 raft_consensus.cc:1226] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:44.472116 23888 tablet_bootstrap.cc:654] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:44.314862 24678 raft_consensus.cc:504] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.416538 24667 raft_consensus.cc:504] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.469782 23772 leader_election.cc:302] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:44.458858 23707 raft_consensus.cc:1226] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:44.442821 24639 raft_consensus.cc:482] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:44.458091 24635 leader_election.cc:288] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:44.475605 23881 ts_tablet_manager.cc:1428] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.156s user 0.010s sys 0.000s
I20260807 13:40:44.466295 24485 leader_election.cc:288] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:44.471551 24642 raft_consensus.cc:482] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:44.355436 24676 raft_consensus.cc:504] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.466905 23591 raft_consensus.cc:2454] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:44.534739 23711 raft_consensus.cc:1261] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:44.540542 23711 raft_consensus.cc:1261] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:44.461647 24637 raft_consensus.cc:504] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.467970 24499 raft_consensus.cc:504] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:44.571722 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 102049us
I20260807 13:40:44.570880 23881 tablet_bootstrap.cc:492] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:40:44.545009 24485 raft_consensus.cc:482] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:44.529284 24635 raft_consensus.cc:482] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:44.464280 24638 raft_consensus.cc:504] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:44.553036 24680 log.cc:924] Time spent T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.230s user 0.001s sys 0.000s
I20260807 13:40:44.577724 24666 leader_election.cc:288] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:44.581084 24485 raft_consensus.cc:504] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.544659 24642 raft_consensus.cc:504] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.582733 24637 leader_election.cc:288] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:44.564730 24634 leader_election.cc:288] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:44.551590 24547 leader_election.cc:288] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:44.578112 24586 leader_election.cc:288] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:44.512044 24639 raft_consensus.cc:504] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:44.587306 23709 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.604s user 0.007s sys 0.013s
I20260807 13:40:44.730506 23662 leader_election.cc:302] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
W20260807 13:40:44.642325 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 402296us
I20260807 13:40:44.712996 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:44.578686 24699 raft_consensus.cc:2726] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:44.729159 23884 tablet_bootstrap.cc:654] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:40:44.739192 23662 leader_election.cc:302] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:44.740651 23662 leader_election.cc:302] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
W20260807 13:40:44.724006 24683 log.cc:924] Time spent T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.368s user 0.000s sys 0.001s
I20260807 13:40:44.646551 24666 raft_consensus.cc:482] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:44.750164 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:44.750851 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:44.730954 23709 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.747s user 0.008s sys 0.014s
W20260807 13:40:44.738842 24579 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s user 0.008s sys 0.026s
I20260807 13:40:44.732028 24547 raft_consensus.cc:482] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:44.738205 24558 leader_election.cc:288] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:44.591081 24635 raft_consensus.cc:504] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.730126 24634 raft_consensus.cc:482] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:44.733397 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:44.760771 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:44.772159 23817 raft_consensus.cc:2379] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 2: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:44.740955 24605 leader_election.cc:288] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:44.739296 24581 leader_election.cc:288] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:44.776396 24632 raft_consensus.cc:482] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:44.757710 23595 raft_consensus.cc:1226] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:44.787611 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:44.760133 24610 raft_consensus.cc:2726] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:44.722002 24707 raft_consensus.cc:482] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:44.788929 23820 raft_consensus.cc:2454] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:44.758002 24623 raft_consensus.cc:2726] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:40:44.768911 24579 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s user 0.008s sys 0.027s
I20260807 13:40:44.758930 24649 leader_election.cc:288] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:44.742712 24674 consensus_queue.cc:1035] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260807 13:40:44.763088 24666 raft_consensus.cc:504] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.805359 24709 raft_consensus.cc:482] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:40:44.779541 24692 log.cc:924] Time spent T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.331s user 0.001s sys 0.000s
I20260807 13:40:44.775751 24557 raft_consensus.cc:482] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:44.920841 23823 raft_consensus.cc:2454] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:44.952014 23555 leader_election.cc:302] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:44.785473 24637 raft_consensus.cc:482] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:45.016904 24714 raft_consensus.cc:482] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:45.017742 24714 raft_consensus.cc:504] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:45.020769 24714 leader_election.cc:288] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:44.789912 24558 raft_consensus.cc:482] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:40:44.888350 24704 log.cc:924] Time spent T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.059s user 0.000s sys 0.000s
I20260807 13:40:44.806180 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:45.028769 24558 raft_consensus.cc:504] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:45.026237 24586 raft_consensus.cc:2781] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:45.032302 24666 leader_election.cc:288] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:45.033744 24581 consensus_queue.cc:1035] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260807 13:40:45.036777 24641 consensus_meta.cc:287] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812: Time spent flushing consensus metadata: real 1.085s user 0.012s sys 0.000s
I20260807 13:40:45.039556 24665 raft_consensus.cc:482] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:44.894245 23814 raft_consensus.cc:1226] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
W20260807 13:40:45.040719 24587 consensus_meta.cc:287] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent flushing consensus metadata: real 0.719s user 0.006s sys 0.006s
I20260807 13:40:45.038285 24638 leader_election.cc:288] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:40:45.072711 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 482568us
I20260807 13:40:45.022449 24649 raft_consensus.cc:482] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:44.986763 24519 raft_consensus.cc:482] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:44.919157 24676 leader_election.cc:288] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:44.920022 24667 leader_election.cc:288] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:44.780373 24547 raft_consensus.cc:504] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:45.026970 24579 raft_consensus.cc:482] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:44.806241 24634 raft_consensus.cc:504] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.861121 24632 raft_consensus.cc:504] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:45.010145 24557 raft_consensus.cc:504] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:44.853868 24605 consensus_queue.cc:1035] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.226s
I20260807 13:40:44.860819 24703 consensus_queue.cc:1035] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.414s
I20260807 13:40:45.023718 24485 leader_election.cc:288] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:45.011996 24709 raft_consensus.cc:504] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:45.069537 24678 leader_election.cc:288] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:45.072808 24610 raft_consensus.cc:482] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:40:45.788486 23821 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.767s user 0.015s sys 0.018s
I20260807 13:40:45.393255 23598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 411) took 1089 ms. Trace:
I20260807 13:40:45.086418 23772 leader_election.cc:302] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
W20260807 13:40:45.618795 23662 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.864s user 0.014s sys 0.024s
W20260807 13:40:45.062848 24701 log.cc:924] Time spent T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.433s user 0.000s sys 0.001s
W20260807 13:40:45.664458 23884 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.643s user 0.012s sys 0.017s
W20260807 13:40:46.038823 23662 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.284s user 0.020s sys 0.052s
W20260807 13:40:46.038972 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 952587us
I20260807 13:40:45.074867 24707 raft_consensus.cc:504] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:45.076787 24641 raft_consensus.cc:2726] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:46.043170 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 454) took 2220 ms. Trace:
I20260807 13:40:46.038038 24579 raft_consensus.cc:504] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:46.044029 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:45.024875 24637 raft_consensus.cc:504] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:45.762807 24644 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.821s user 0.012s sys 0.017s
I20260807 13:40:45.463522 24651 leader_election.cc:288] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:45.995307 23555 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.915s user 0.014s sys 0.030s
W20260807 13:40:46.067319 23555 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.987s user 0.014s sys 0.033s
W20260807 13:40:45.982425 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 566903us
I20260807 13:40:45.071667 24639 leader_election.cc:288] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:45.256727 24664 log.cc:924] Time spent T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 1.222s user 0.005s sys 0.000s
W20260807 13:40:45.402029 24705 log.cc:924] Time spent T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.583s user 0.000s sys 0.001s
I20260807 13:40:45.080535 24586 raft_consensus.cc:686] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:45.980383 24678 raft_consensus.cc:482] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
W20260807 13:40:45.922852 23709 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.072s user 0.012s sys 0.000s
W20260807 13:40:46.060698 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 1.31808e+06us
W20260807 13:40:46.060400 23884 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 1.039s user 0.013s sys 0.034s
I20260807 13:40:46.043823 23598 rpcz_store.cc:276] 0807 13:40:44.303994 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:44.304276 (+ 282us) service_pool.cc:227] Handling call
0807 13:40:45.392992 (+1088716us) spinlock_profiling.cc:243] Waited 39.6 ms on lock 0x7b54002f35d4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:40:45.393133 (+ 141us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":90985856}
W20260807 13:40:45.062029 24690 thread.cc:636] apply [worker] (thread pool) Time spent creating pthread: real 0.541s user 0.041s sys 0.089s
W20260807 13:40:45.988175 23888 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 1.195s user 0.006s sys 0.006s
W20260807 13:40:46.070560 24644 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.192s user 0.014s sys 0.029s
W20260807 13:40:45.663582 23554 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.859s user 0.000s sys 0.027s
W20260807 13:40:45.465732 24643 consensus_meta.cc:287] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 1.145s user 0.006s sys 0.007s
I20260807 13:40:45.141294 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:46.095821 23703 raft_consensus.cc:2379] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 2: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
W20260807 13:40:45.446547 24679 log.cc:924] Time spent T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 1.167s user 0.011s sys 0.028s
W20260807 13:40:45.987658 23813 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s user 0.006s sys 0.004s
W20260807 13:40:46.088992 23709 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.261s user 0.015s sys 0.001s
I20260807 13:40:45.195572 24587 raft_consensus.cc:482] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:45.439299 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:45.336732 24708 raft_consensus.cc:2726] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:45.351274 24635 leader_election.cc:288] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:45.408038 24558 leader_election.cc:288] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:46.046252 24634 leader_election.cc:288] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:45.218030 24665 raft_consensus.cc:504] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:45.401096 24611 leader_election.cc:288] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:45.657388 23774 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.904s user 0.001s sys 0.039s
I20260807 13:40:46.089664 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:46.090477 23662 leader_election.cc:302] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
W20260807 13:40:46.090516 23888 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 1.297s user 0.009s sys 0.006s
I20260807 13:40:46.089869 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:45.286545 24714 raft_consensus.cc:482] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:40:46.050354 23821 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.018s user 0.023s sys 0.022s
I20260807 13:40:45.423360 24623 raft_consensus.cc:482] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:46.053907 24485 raft_consensus.cc:482] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:45.461663 24581 raft_consensus.cc:482] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:46.046277 24709 leader_election.cc:288] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:45.583978 24496 consensus_meta.cc:287] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 1.200s user 0.012s sys 0.000s
W20260807 13:40:46.096875 23554 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.317s user 0.001s sys 0.040s
W20260807 13:40:46.067262 23663 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.850s user 0.005s sys 0.021s
I20260807 13:40:45.368274 23710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 460) took 1424 ms. Trace:
I20260807 13:40:45.396485 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:46.156747 24714 raft_consensus.cc:504] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:46.164777 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:46.156895 24623 raft_consensus.cc:504] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:46.165398 23707 raft_consensus.cc:2454] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:46.165678 24714 leader_election.cc:288] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:46.166236 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:46.106230 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:46.080699 24641 raft_consensus.cc:482] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:45.066774 23825 raft_consensus.cc:2454] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:45.194832 24519 raft_consensus.cc:504] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:45.194264 24649 raft_consensus.cc:504] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:45.993775 24610 raft_consensus.cc:504] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:45.084551 24666 consensus_queue.cc:1046] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 1.009s
I20260807 13:40:45.367002 24719 raft_consensus.cc:482] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:46.055094 24723 raft_consensus.cc:2726] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260807 13:40:46.106135 24648 consensus_meta.cc:287] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 1.839s user 0.013s sys 0.004s
I20260807 13:40:46.109732 24678 raft_consensus.cc:504] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:45.367657 24711 raft_consensus.cc:482] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
W20260807 13:40:46.106069 23813 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s user 0.008s sys 0.007s
I20260807 13:40:46.159138 24703 consensus_queue.cc:1035] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
W20260807 13:40:46.111425 24690 thread.cc:602] apply [worker] (thread pool) Time spent starting thread: real 1.620s user 0.054s sys 0.124s
I20260807 13:40:45.604920 24544 raft_consensus.cc:482] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:46.135089 23590 raft_consensus.cc:3037] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:46.084728 23705 raft_consensus.cc:2454] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:46.087707 24726 raft_consensus.cc:482] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:40:46.148662 23660 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.390s user 0.032s sys 0.083s
W20260807 13:40:46.109252 24608 consensus_meta.cc:287] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 1.719s user 0.015s sys 0.000s
I20260807 13:40:46.150979 23601 raft_consensus.cc:2454] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:46.109517 24644 raft_consensus.cc:482] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
W20260807 13:40:46.155694 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 65309.9us
I20260807 13:40:46.152554 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:46.162273 23554 leader_election.cc:302] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:46.152685 24634 raft_consensus.cc:482] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:46.163198 24707 leader_election.cc:288] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:46.166909 24623 leader_election.cc:288] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:45.798907 23556 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.548s user 0.000s sys 0.010s
I20260807 13:40:46.200181 23707 raft_consensus.cc:2454] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:46.108007 24643 raft_consensus.cc:504] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:46.148658 24635 raft_consensus.cc:482] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:40:46.150629 23774 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.405s user 0.009s sys 0.046s
I20260807 13:40:46.153033 24558 raft_consensus.cc:482] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:46.155247 24611 raft_consensus.cc:482] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:46.158550 24676 raft_consensus.cc:482] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:46.131193 24587 raft_consensus.cc:504] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:46.202914 23825 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 203) took 1617 ms (client timeout 1831 ms). Trace:
W20260807 13:40:46.201205 23818 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 200) took 1584 ms (client timeout 2037 ms). Trace:
I20260807 13:40:46.172698 24496 raft_consensus.cc:504] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:46.216902 23660 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.461s user 0.032s sys 0.083s
I20260807 13:40:46.222143 24733 consensus_queue.cc:1035] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:46.168493 24485 raft_consensus.cc:504] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:46.223533 23881 tablet_bootstrap.cc:654] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
W20260807 13:40:46.209120 24653 consensus_meta.cc:287] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 1.752s user 0.014s sys 0.003s
I20260807 13:40:46.221015 23703 raft_consensus.cc:2454] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:46.218639 23662 leader_election.cc:302] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:46.205091 24708 raft_consensus.cc:2726] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:46.214605 24648 raft_consensus.cc:504] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:46.229465 23888 tablet_bootstrap.cc:492] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:40:46.372035 23888 ts_tablet_manager.cc:1397] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 2.485s user 0.017s sys 0.014s
W20260807 13:40:46.229523 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 67325us
I20260807 13:40:46.373164 23884 tablet_bootstrap.cc:492] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:40:46.373780 23884 ts_tablet_manager.cc:1397] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 2.136s user 0.025s sys 0.045s
I20260807 13:40:46.374157 23554 leader_election.cc:302] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:46.211694 24711 raft_consensus.cc:504] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:46.267792 24632 leader_election.cc:288] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:46.218947 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 471) took 1721 ms. Trace:
I20260807 13:40:46.168073 24586 consensus_queue.cc:237] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:46.235232 24642 leader_election.cc:288] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:46.225422 24634 raft_consensus.cc:504] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:46.235513 24678 leader_election.cc:288] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:46.204169 23663 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.427s user 0.006s sys 0.022s
I20260807 13:40:46.263195 24558 raft_consensus.cc:504] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:46.265105 23818 rpcz_store.cc:269] 0807 13:40:44.584303 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:44.593055 (+ 8752us) service_pool.cc:227] Handling call
0807 13:40:45.439013 (+845958us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b5800255098. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f4620fef1b0 00007f4620feea94 00007f461a6d6c04 00007f461a6d6b92
0807 13:40:46.160923 (+721910us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":30224768}
I20260807 13:40:46.265575 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:46.066560 23700 rpcz_store.cc:276] 0807 13:40:43.822341 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:43.825471 (+ 3130us) service_pool.cc:227] Handling call
0807 13:40:43.853600 (+ 28129us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:43.869956 (+ 16356us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:43.871753 (+ 1797us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:43.897039 (+ 25286us) log.cc:842] Serialized 26 byte log entry
0807 13:40:44.221226 (+324187us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:40:44.234364 (+ 13138us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:44.242218 (+ 7854us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:46.042835 (+1800617us) raft_consensus.cc:1671] finished
0807 13:40:46.042869 (+ 34us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:46.043069 (+ 200us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":448,"raft.queue_time_us":3424,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":5030,"thread_start_us":311115,"threads_started":1,"wal-append.queue_time_us":496163}
I20260807 13:40:46.203102 24641 raft_consensus.cc:504] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:46.218120 23601 raft_consensus.cc:1261] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260807 13:40:46.230715 23556 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.011s user 0.000s sys 0.016s
I20260807 13:40:46.208179 24581 raft_consensus.cc:504] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:46.364266 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 216) took 1163 ms. Trace:
I20260807 13:40:46.293994 24676 raft_consensus.cc:504] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:46.230594 24651 raft_consensus.cc:2726] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:40:46.231799 23705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 473) took 1087 ms. Trace:
I20260807 13:40:46.206938 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 438) took 3121 ms. Trace:
I20260807 13:40:46.283591 24605 raft_consensus.cc:482] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:46.239589 24547 leader_election.cc:288] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:46.270396 23815 raft_consensus.cc:1261] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:46.234164 24637 leader_election.cc:288] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:46.363899 24623 raft_consensus.cc:482] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:46.236259 23813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45360 (request call id 413) took 1485 ms. Trace:
I20260807 13:40:46.263546 24557 leader_election.cc:288] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:46.223342 24726 raft_consensus.cc:504] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:46.223197 24644 raft_consensus.cc:504] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:46.229682 24544 raft_consensus.cc:504] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:46.365545 24579 leader_election.cc:288] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:40:46.266995 23825 rpcz_store.cc:269] 0807 13:40:44.585312 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:44.586459 (+ 1147us) service_pool.cc:227] Handling call
0807 13:40:46.202830 (+1616371us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:46.427004 24707 raft_consensus.cc:482] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:46.421816 24610 leader_election.cc:288] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:46.293186 24611 raft_consensus.cc:504] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:46.384163 23595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 453) took 2485 ms. Trace:
I20260807 13:40:46.409503 23707 raft_consensus.cc:2454] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
W20260807 13:40:46.409931 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 340030us
I20260807 13:40:46.381963 24708 raft_consensus.cc:482] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:46.217350 24719 raft_consensus.cc:504] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:46.480783 23703 rpcz_store.cc:276] 0807 13:40:45.200842 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:46.107236 (+906394us) service_pool.cc:227] Handling call
0807 13:40:46.364183 (+256947us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:46.469002 24502 raft_consensus.cc:482] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:46.473906 24605 raft_consensus.cc:504] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:46.469019 24741 log.cc:924] Time spent T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.320s user 0.001s sys 0.001s
I20260807 13:40:46.218966 24725 consensus_queue.cc:1035] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.250s
I20260807 13:40:46.398763 24519 leader_election.cc:288] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:46.382500 24666 consensus_queue.cc:1046] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.093s
I20260807 13:40:46.458443 24727 raft_consensus.cc:482] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:46.447906 24714 raft_consensus.cc:482] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:46.427070 24642 raft_consensus.cc:482] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:46.437191 24709 raft_consensus.cc:482] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:46.421622 23709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 462) took 2439 ms. Trace:
I20260807 13:40:46.436995 24653 raft_consensus.cc:482] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:46.458443 24721 raft_consensus.cc:482] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:40:46.490712 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 272125us
I20260807 13:40:46.421277 24587 leader_election.cc:288] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:46.235935 24635 raft_consensus.cc:504] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:46.493817 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:46.427785 24678 raft_consensus.cc:482] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:46.226867 24608 raft_consensus.cc:504] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:46.497735 23555 leader_election.cc:302] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:46.513657 24662 consensus_queue.cc:1035] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260807 13:40:46.486428 24547 raft_consensus.cc:482] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:46.489869 24637 raft_consensus.cc:482] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:46.490626 24557 raft_consensus.cc:482] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:46.459618 24665 leader_election.cc:288] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:46.471946 24739 raft_consensus.cc:482] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:40:46.499523 24737 log.cc:924] Time spent T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.269s user 0.001s sys 0.000s
I20260807 13:40:46.489259 24651 raft_consensus.cc:482] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:46.506434 24499 leader_election.cc:288] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:46.488670 23815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45360 (request call id 416) took 1738 ms. Trace:
I20260807 13:40:46.515892 23772 leader_election.cc:302] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:46.494935 24744 raft_consensus.cc:482] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:46.483992 24748 raft_consensus.cc:2781] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:46.499855 24649 leader_election.cc:288] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:46.495239 24632 raft_consensus.cc:482] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:46.523751 23599 raft_consensus.cc:1261] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:46.486682 24623 raft_consensus.cc:504] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:46.499716 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:46.478308 23705 rpcz_store.cc:276] 0807 13:40:45.136361 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:45.136544 (+ 183us) service_pool.cc:227] Handling call
0807 13:40:46.223785 (+1087241us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:46.532624 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:46.384210 23702 rpcz_store.cc:276] 0807 13:40:44.497247 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:44.552007 (+ 54760us) service_pool.cc:227] Handling call
0807 13:40:46.218136 (+1666129us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b5800004598. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f46210032b0 00007f4620fee7f9 00007f4620fee2a2 00007f461a6d4684
0807 13:40:46.218336 (+ 200us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:46.218529 (+ 193us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:46.218556 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:46.218605 (+ 49us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:46.218639 (+ 34us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:46.218743 (+ 104us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:46.218883 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":24920832}
I20260807 13:40:46.507190 24610 raft_consensus.cc:482] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:46.508885 24643 leader_election.cc:288] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:46.492395 24745 raft_consensus.cc:482] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:46.514367 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:46.505650 23707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 214) took 1305 ms. Trace:
W20260807 13:40:46.594403 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 96730us
I20260807 13:40:46.501588 24707 raft_consensus.cc:504] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:46.593170 23662 leader_election.cc:302] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
W20260807 13:40:46.537822 24682 log.cc:924] Time spent T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 2.035s user 0.004s sys 0.008s
I20260807 13:40:46.522349 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:46.602262 23535 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260807 13:40:46.606097 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 321519us
I20260807 13:40:46.524956 24496 leader_election.cc:288] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:46.559459 23594 raft_consensus.cc:2454] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:46.533318 24519 raft_consensus.cc:482] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:46.523452 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:46.520623 24502 raft_consensus.cc:504] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:46.981298 23711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 476) took 1843 ms. Trace:
I20260807 13:40:46.604295 24547 raft_consensus.cc:504] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:47.069103 24667 raft_consensus.cc:3032] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:47.128324 23821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45360 (request call id 412) took 2379 ms. Trace:
I20260807 13:40:46.595387 24653 raft_consensus.cc:504] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:46.611269 23884 raft_consensus.cc:348] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:47.126992 24667 raft_consensus.cc:729] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:47.064540 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:47.132095 23884 raft_consensus.cc:374] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260807 13:40:47.136474 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 620649us
I20260807 13:40:47.136780 23884 raft_consensus.cc:729] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:40:47.087285 23600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 464) took 1012 ms. Trace:
I20260807 13:40:47.135993 23555 leader_election.cc:302] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:46.954000 24747 raft_consensus.cc:482] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:47.140703 23555 leader_election.cc:302] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:46.687484 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:46.167505 23710 rpcz_store.cc:276] 0807 13:40:43.943515 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:43.945119 (+ 1604us) service_pool.cc:227] Handling call
0807 13:40:43.991995 (+ 46876us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:44.074177 (+ 82182us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:44.074212 (+ 35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:44.117594 (+ 43382us) log.cc:842] Serialized 26 byte log entry
0807 13:40:44.531808 (+414214us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:44.554677 (+ 22869us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:44.573570 (+ 18893us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:45.349628 (+776058us) raft_consensus.cc:1671] finished
0807 13:40:45.350213 (+ 585us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:45.368174 (+ 17961us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":4867,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":9012,"thread_start_us":293592,"threads_started":1,"wal-append.queue_time_us":572760,"wal-append.run_cpu_time_us":6484,"wal-append.run_wall_time_us":1640225}
I20260807 13:40:46.532296 24644 leader_election.cc:288] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:40:47.137527 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 544452us
I20260807 13:40:46.688686 23597 raft_consensus.cc:2454] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:47.145505 23888 raft_consensus.cc:348] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:46.816636 24752 raft_consensus.cc:482] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:47.038007 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:46.559058 24714 raft_consensus.cc:504] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:46.520788 24708 raft_consensus.cc:504] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:46.561374 24642 raft_consensus.cc:504] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:47.449070 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 305907us
I20260807 13:40:47.543679 23598 raft_consensus.cc:1261] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:47.555305 23598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 470) took 1478 ms. Trace:
I20260807 13:40:47.555548 23662 leader_election.cc:302] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:47.556828 23662 leader_election.cc:302] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:47.555748 23598 rpcz_store.cc:276] 0807 13:40:46.076471 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:47.425620 (+1349149us) service_pool.cc:227] Handling call
0807 13:40:47.539773 (+114153us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:47.555054 (+ 15281us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:47.555252 (+ 198us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:47.122282 23711 rpcz_store.cc:276] 0807 13:40:45.137406 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:45.137949 (+ 543us) service_pool.cc:227] Handling call
0807 13:40:45.980635 (+842686us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:46.410253 (+429618us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:46.410297 (+ 44us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:46.410357 (+ 60us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:46.410412 (+ 55us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:46.962580 (+552168us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b540039b2d4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:40:46.980110 (+ 17530us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:46.981045 (+ 935us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":987428096}
I20260807 13:40:47.425609 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:47.146721 23707 rpcz_store.cc:276] 0807 13:40:45.200254 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:46.232835 (+1032581us) service_pool.cc:227] Handling call
0807 13:40:46.505588 (+272753us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:47.150205 23447 rpcz_store.cc:275] Call kudu.master.MasterService.IsCreateTableDone from 127.0.0.1:37978 (request call id 41) took 1298 ms. Trace:
W20260807 13:40:47.300247 23703 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 215) took 2099 ms (client timeout 1862 ms). Trace:
I20260807 13:40:47.558852 23601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 469) took 1482 ms. Trace:
I20260807 13:40:47.558704 23660 leader_election.cc:302] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:47.567101 23888 raft_consensus.cc:374] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:47.567597 23888 raft_consensus.cc:729] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
W20260807 13:40:47.565106 23703 rpcz_store.cc:269] 0807 13:40:45.200553 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:46.507661 (+1307108us) service_pool.cc:227] Handling call
0807 13:40:47.300110 (+792449us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:47.568084 23823 raft_consensus.cc:1261] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:47.569013 23823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45370 (request call id 210) took 1076 ms. Trace:
I20260807 13:40:47.569159 23888 consensus_queue.cc:260] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:47.314839 23884 consensus_queue.cc:260] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:46.804610 23590 consensus_meta.cc:287] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent flushing consensus metadata: real 0.586s user 0.013s sys 0.000s
I20260807 13:40:47.564713 23447 rpcz_store.cc:276] 0807 13:40:45.885592 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:45.885818 (+ 226us) service_pool.cc:227] Handling call
0807 13:40:47.117201 (+1231383us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54002dffd4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032af0 00007f461c0b5f2a 00007f4622007d6c 00007f46221032c6 00007f462041d5b4 00007f462041d542 00007f462041d471 00007f462041d3ec 00007f462041c6a2 00007f461a4d794c 00007f461a4d6d86
0807 13:40:47.117678 (+ 477us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0807 13:40:47.118370 (+ 692us) catalog_manager.cc:2245] Verify if the table creation is in progress for test-workload [id=14f16c1129ee464da3f6afb00584355d]
0807 13:40:47.122493 (+ 4123us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":768151808}
I20260807 13:40:47.576530 24758 raft_consensus.cc:2781] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:46.600744 24666 raft_consensus.cc:2781] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:47.129878 23821 rpcz_store.cc:276] 0807 13:40:44.748618 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:44.748780 (+ 162us) service_pool.cc:227] Handling call
0807 13:40:44.749176 (+ 396us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:44.779056 (+ 29880us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:44.786004 (+ 6948us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:44.922100 (+136096us) log.cc:842] Serialized 26 byte log entry
0807 13:40:46.162920 (+1240820us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:46.162987 (+ 67us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:46.163068 (+ 81us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:47.127332 (+964264us) raft_consensus.cc:1671] finished
0807 13:40:47.127513 (+ 181us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:47.128112 (+ 599us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":15973,"raft.queue_time_us":27351,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"thread_start_us":1166800,"threads_started":1,"wal-append.queue_time_us":1237332}
W20260807 13:40:47.573822 23707 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 227) took 2159 ms (client timeout 1860 ms). Trace:
I20260807 13:40:47.138103 23600 rpcz_store.cc:276] 0807 13:40:46.074492 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:46.231234 (+156742us) service_pool.cc:227] Handling call
0807 13:40:46.263699 (+ 32465us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:46.491296 (+227597us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:46.491327 (+ 31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:46.491371 (+ 44us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:46.491410 (+ 39us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:47.074156 (+582746us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54002544d4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:40:47.074278 (+ 122us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:47.074618 (+ 340us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":522991360}
I20260807 13:40:47.569891 23820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 212) took 1076 ms. Trace:
W20260807 13:40:46.602102 23554 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.82.67:46685 timed out after 1.831s (SENT) [suppressed 38 similar messages]
W20260807 13:40:47.574074 23711 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 212) took 2374 ms (client timeout 2037 ms). Trace:
I20260807 13:40:47.565989 23601 rpcz_store.cc:276] 0807 13:40:46.076220 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:46.646237 (+570017us) service_pool.cc:227] Handling call
0807 13:40:46.709118 (+ 62881us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:47.558489 (+849371us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:47.558525 (+ 36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:47.558570 (+ 45us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:47.558596 (+ 26us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:47.558677 (+ 81us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:47.558786 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:40:47.558421 23772 connection.cc:232] RPC call timeout handler was delayed by -2.8192145992070436s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
I20260807 13:40:47.569459 23823 rpcz_store.cc:276] 0807 13:40:46.492948 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:47.444269 (+951321us) service_pool.cc:227] Handling call
0807 13:40:47.558062 (+113793us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:47.568688 (+ 10626us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:47.568947 (+ 259us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:46.647809 24485 leader_election.cc:288] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:46.709295 24634 leader_election.cc:288] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:47.590811 23703 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 224) took 2163 ms (client timeout 1870 ms). Trace:
I20260807 13:40:47.564584 23815 rpcz_store.cc:276] 0807 13:40:44.750111 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:44.846964 (+ 96853us) service_pool.cc:227] Handling call
0807 13:40:46.222388 (+1375424us) spinlock_profiling.cc:243] Waited 6.84 ms on lock 0x7b5800255098. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f46210032b0 00007f4620fee7f9 00007f4620fee2a2 00007f461a6d4684
0807 13:40:46.222603 (+ 215us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:46.471265 (+248662us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:46.487207 (+ 15942us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":15737088}
W20260807 13:40:47.643607 23703 rpcz_store.cc:269] 0807 13:40:45.404941 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:47.568564 (+2163623us) service_pool.cc:214] Skipping call since client already timed out
0807 13:40:47.568750 (+ 186us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260807 13:40:47.644358 24758 raft_consensus.cc:482] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:46.812561 24726 leader_election.cc:288] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:47.644791 24758 raft_consensus.cc:3037] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:47.566241 24733 raft_consensus.cc:2781] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260807 13:40:46.798118 24746 log.cc:924] Time spent T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.270s user 0.001s sys 0.000s
I20260807 13:40:46.600039 24648 leader_election.cc:288] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:47.466688 24702 raft_consensus.cc:2781] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:47.552637 24547 leader_election.cc:288] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:47.638767 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 1.03662e+06us
I20260807 13:40:46.607417 24641 leader_election.cc:288] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:47.638697 23711 rpcz_store.cc:269] 0807 13:40:45.199520 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:47.573898 (+2374378us) service_pool.cc:214] Skipping call since client already timed out
0807 13:40:47.574014 (+ 116us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260807 13:40:47.641126 23881 tablet_bootstrap.cc:492] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:40:47.470906 24662 consensus_queue.cc:1035] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.179s
I20260807 13:40:47.692883 23881 ts_tablet_manager.cc:1397] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 3.165s user 0.043s sys 0.040s
I20260807 13:40:46.598371 24678 raft_consensus.cc:504] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:47.642570 23599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 462) took 1563 ms. Trace:
I20260807 13:40:46.596741 24709 raft_consensus.cc:504] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:47.644212 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:47.644529 23703 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 220) took 2442 ms (client timeout 2093 ms). Trace:
I20260807 13:40:47.466310 24653 leader_election.cc:288] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:47.469799 24719 leader_election.cc:288] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:47.465009 23700 raft_consensus.cc:2379] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
W20260807 13:40:47.596746 23707 rpcz_store.cc:269] 0807 13:40:45.405795 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:47.564881 (+2159086us) service_pool.cc:214] Skipping call since client already timed out
0807 13:40:47.564992 (+ 111us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260807 13:40:46.503618 23595 rpcz_store.cc:276] 0807 13:40:43.889190 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:43.893532 (+ 4342us) service_pool.cc:227] Handling call
0807 13:40:43.914592 (+ 21060us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:44.986056 (+1071464us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:46.283208 (+1297152us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b54000e4a54. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:40:46.374767 (+ 91559us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1889413888}
I20260807 13:40:46.804987 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:47.468091 24496 raft_consensus.cc:482] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:47.150378 24760 raft_consensus.cc:2781] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260807 13:40:47.465755 23702 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 219) took 2264 ms (client timeout 1939 ms). Trace:
I20260807 13:40:46.811247 24722 raft_consensus.cc:482] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:47.469211 24581 leader_election.cc:288] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:46.846791 24711 leader_election.cc:288] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:46.687412 24608 leader_election.cc:288] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:47.133551 24632 raft_consensus.cc:504] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:47.567625 24748 raft_consensus.cc:482] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:47.329228 24643 raft_consensus.cc:2781] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:46.972095 24605 leader_election.cc:288] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:46.685835 24665 raft_consensus.cc:482] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:46.803481 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4062e0223a4cc0b2e448e35445671d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:47.132081 24611 leader_election.cc:288] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:46.973794 24544 leader_election.cc:288] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:46.734000 24558 leader_election.cc:288] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:47.659479 23448 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37962 (request call id 135) took 4445 ms. Trace:
I20260807 13:40:47.726135 23814 raft_consensus.cc:1261] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:47.813630 24708 leader_election.cc:288] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:47.569582 23705 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 217) took 2368 ms (client timeout 1980 ms). Trace:
I20260807 13:40:47.597559 23820 rpcz_store.cc:276] 0807 13:40:46.493536 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:47.425258 (+931722us) service_pool.cc:227] Handling call
0807 13:40:47.569824 (+144566us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:40:47.676599 23597 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 417) took 1605 ms (client timeout 2018 ms). Trace:
I20260807 13:40:47.645084 24726 consensus_queue.cc:1035] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:47.128572 23812 raft_consensus.cc:2454] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:47.570537 23818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 204) took 1089 ms. Trace:
I20260807 13:40:46.667205 24721 raft_consensus.cc:504] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:47.634642 24666 raft_consensus.cc:482] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
W20260807 13:40:47.692935 23711 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 480) took 2554 ms (client timeout 2262 ms). Trace:
W20260807 13:40:47.599828 23594 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 456) took 3679 ms (client timeout 1505 ms). Trace:
W20260807 13:40:47.708020 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 149401us
I20260807 13:40:47.131165 24651 raft_consensus.cc:504] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:46.607872 24637 raft_consensus.cc:504] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:47.730173 24496 raft_consensus.cc:504] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:47.856866 24637 leader_election.cc:288] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:47.427613 24519 raft_consensus.cc:504] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:47.857303 24496 leader_election.cc:288] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:47.839675 24754 raft_consensus.cc:2781] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260807 13:40:47.714417 23703 rpcz_store.cc:269] 0807 13:40:45.201999 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:47.644346 (+2442347us) service_pool.cc:214] Skipping call since client already timed out
0807 13:40:47.644470 (+ 124us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260807 13:40:47.858510 24754 raft_consensus.cc:482] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:47.859061 24754 raft_consensus.cc:3037] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:40:47.859134 23703 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 221) took 2455 ms (client timeout 2017 ms). Trace:
W20260807 13:40:47.859596 23703 rpcz_store.cc:269] 0807 13:40:45.403884 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:47.858960 (+2455076us) service_pool.cc:214] Skipping call since client already timed out
0807 13:40:47.859073 (+ 113us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260807 13:40:47.860374 23703 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 228) took 2454 ms (client timeout 2032 ms). Trace:
W20260807 13:40:47.860682 23703 rpcz_store.cc:269] 0807 13:40:45.406075 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:47.860212 (+2454137us) service_pool.cc:214] Skipping call since client already timed out
0807 13:40:47.860326 (+ 114us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260807 13:40:47.861409 23703 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 233) took 1779 ms (client timeout 1649 ms). Trace:
W20260807 13:40:47.861711 23703 rpcz_store.cc:269] 0807 13:40:46.082163 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:47.861270 (+1779107us) service_pool.cc:214] Skipping call since client already timed out
0807 13:40:47.861366 (+ 96us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260807 13:40:47.712461 23599 rpcz_store.cc:276] 0807 13:40:46.073969 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:46.152392 (+ 78423us) service_pool.cc:227] Handling call
0807 13:40:46.163513 (+ 11121us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:47.135826 (+972313us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:47.636846 (+501020us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b54002f3ad4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:40:47.637054 (+ 208us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":827688704}
I20260807 13:40:47.718524 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:47.863152 24762 log.cc:924] Time spent T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.224s user 0.000s sys 0.000s
I20260807 13:40:47.595851 24752 raft_consensus.cc:504] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:47.862397 23703 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 235) took 1777 ms (client timeout 1700 ms). Trace:
I20260807 13:40:47.656744 24733 raft_consensus.cc:482] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:46.608498 24557 raft_consensus.cc:504] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:47.561879 24747 raft_consensus.cc:504] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:47.754343 23700 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 213) took 2551 ms (client timeout 1831 ms). Trace:
I20260807 13:40:47.652418 24635 leader_election.cc:288] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:47.660933 23825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 213) took 1159 ms. Trace:
I20260807 13:40:47.896406 23825 rpcz_store.cc:276] 0807 13:40:46.496092 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:46.501145 (+ 5053us) service_pool.cc:227] Handling call
0807 13:40:47.037600 (+536455us) spinlock_profiling.cc:243] Waited 9.97 ms on lock 0x7b5800255098. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f4620fef1b0 00007f4620feea94 00007f461a6d6c04 00007f461a6d6b92
0807 13:40:47.655451 (+617851us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":22932864}
I20260807 13:40:47.897804 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:47.675289 23590 raft_consensus.cc:1261] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260807 13:40:47.658908 23710 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 229) took 2252 ms (client timeout 1872 ms). Trace:
I20260807 13:40:47.852248 23812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 209) took 1359 ms. Trace:
I20260807 13:40:47.839596 24583 raft_consensus.cc:482] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:47.485950 24667 consensus_queue.cc:260] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:47.709246 23591 raft_consensus.cc:1261] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:47.708120 24649 raft_consensus.cc:482] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:47.734926 23888 ts_tablet_manager.cc:1428] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 1.363s user 0.020s sys 0.012s
I20260807 13:40:47.714751 24641 raft_consensus.cc:482] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:47.716879 24547 raft_consensus.cc:2726] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:40:47.304601 24744 raft_consensus.cc:504] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:47.581652 24745 raft_consensus.cc:504] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:47.815790 24665 raft_consensus.cc:504] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:47.761917 23449 catalog_manager.cc:5495] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 1 to 2, leader changed from 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66) to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 2 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:47.802788 23881 raft_consensus.cc:348] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:47.913663 23881 raft_consensus.cc:374] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:40:47.913951 23881 raft_consensus.cc:729] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:40:47.809407 24643 raft_consensus.cc:482] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:47.762758 24748 raft_consensus.cc:3037] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:40:47.810673 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 241553us
I20260807 13:40:47.733704 24702 raft_consensus.cc:686] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
W20260807 13:40:47.735134 24586 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.047s user 0.019s sys 0.039s
I20260807 13:40:47.753902 23817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 208) took 1276 ms. Trace:
W20260807 13:40:47.815037 23597 rpcz_store.cc:269] 0807 13:40:46.071223 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:46.084018 (+ 12795us) service_pool.cc:227] Handling call
0807 13:40:47.676409 (+1592391us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b540024c054. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:40:47.676536 (+ 127us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1123487616}
I20260807 13:40:47.840519 23884 ts_tablet_manager.cc:1428] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 1.466s user 0.062s sys 0.114s
I20260807 13:40:47.807874 23448 rpcz_store.cc:276] 0807 13:40:43.201493 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:43.201714 (+ 221us) service_pool.cc:227] Handling call
0807 13:40:47.646563 (+4444849us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:40:43.564452 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:40:43.774594 (+210142us) spinlock_profiling.cc:243] Waited 3.85 ms on lock 0x7b5c0026fe0c. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4622436501 00007f46224363f1 00007f462243112c 00007f461fad0a59 00007f461fabc603 00007f461fabc2b8 00007f461fac0ba1 00007f461fac0b59 00007f461fac0ae9 00007f461fac0ab1 00007f461fabfdad
0807 13:40:43.804450 (+ 29856us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:40:43.805724 (+ 1274us) write_op.cc:435] Acquired schema lock
0807 13:40:43.808133 (+ 2409us) tablet.cc:660] Decoding operations
0807 13:40:43.808956 (+ 823us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:40:43.809035 (+ 79us) write_op.cc:641] Partition lock acquired for write op
0807 13:40:43.809074 (+ 39us) tablet.cc:683] Acquiring locks for 4 operations
0807 13:40:43.809547 (+ 473us) tablet.cc:699] Row locks acquired
0807 13:40:43.809566 (+ 19us) write_op.cc:260] PREPARE: finished
0807 13:40:43.809743 (+ 177us) write_op.cc:270] Start()
0807 13:40:43.810000 (+ 257us) write_op.cc:276] Timestamp: P: 1786110043809695 usec, L: 0
0807 13:40:43.810028 (+ 28us) op_driver.cc:331] REPLICATION: starting
0807 13:40:43.813267 (+ 3239us) log.cc:842] Serialized 1693 byte log entry
0807 13:40:44.439786 (+626519us) op_driver.cc:444] REPLICATION: finished
0807 13:40:46.113017 (+1673231us) write_op.cc:301] APPLY: starting
0807 13:40:46.131621 (+ 18604us) tablet.cc:1365] starting BulkCheckPresence
0807 13:40:46.162167 (+ 30546us) tablet.cc:1368] finished BulkCheckPresence
0807 13:40:46.167758 (+ 5591us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:40:46.407287 (+239529us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:40:46.470518 (+ 63231us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0807 13:40:46.475806 (+ 5288us) write_op.cc:312] APPLY: finished
0807 13:40:46.504051 (+ 28245us) log.cc:842] Serialized 40 byte log entry
0807 13:40:46.644484 (+140433us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:40:46.644643 (+ 159us) write_op.cc:454] Released schema lock
0807 13:40:46.644709 (+ 66us) write_op.cc:341] FINISH: Updating metrics
0807 13:40:47.473186 (+828477us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:40:47.473225 (+ 39us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":1625741,"apply.run_cpu_time_us":70834,"apply.run_wall_time_us":1371735,"num_ops":4,"prepare.queue_time_us":232,"prepare.run_cpu_time_us":13783,"prepare.run_wall_time_us":254717,"replication_time_us":621797,"spinlock_wait_cycles":8846208,"thread_start_us":1847667,"threads_started":2,"wal-append.queue_time_us":1093398}]]}
W20260807 13:40:47.926214 23884 ts_tablet_manager.cc:1460] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37: Tablet startup took 1552ms
I20260807 13:40:47.731961 24719 raft_consensus.cc:482] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:47.927917 24642 leader_election.cc:288] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:47.927994 24719 raft_consensus.cc:504] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:47.928761 24678 leader_election.cc:288] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:47.730333 24760 raft_consensus.cc:482] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:47.816375 23588 raft_consensus.cc:2454] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:47.841547 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:46.561378 24727 raft_consensus.cc:504] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:47.853780 23711 rpcz_store.cc:269] 0807 13:40:45.138728 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:47.692741 (+2554013us) service_pool.cc:214] Skipping call since client already timed out
0807 13:40:47.692874 (+ 133us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260807 13:40:47.732278 24648 raft_consensus.cc:482] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:47.863905 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:47.720672 23707 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 226) took 2315 ms (client timeout 2014 ms). Trace:
W20260807 13:40:47.864584 23703 rpcz_store.cc:269] 0807 13:40:46.085457 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:47.862237 (+1776780us) service_pool.cc:214] Skipping call since client already timed out
0807 13:40:47.862356 (+ 119us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260807 13:40:47.814723 23705 rpcz_store.cc:269] 0807 13:40:45.201140 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:47.536425 (+2335285us) service_pool.cc:214] Skipping call since client already timed out
0807 13:40:47.565359 (+ 28934us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260807 13:40:47.730557 23702 rpcz_store.cc:269] 0807 13:40:45.201733 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:47.465488 (+2263755us) service_pool.cc:214] Skipping call since client already timed out
0807 13:40:47.465644 (+ 156us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260807 13:40:47.751896 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:47.973569 23595 raft_consensus.cc:1261] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:47.906843 24649 raft_consensus.cc:504] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:47.974226 23821 raft_consensus.cc:2396] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:40:47.329561 24610 raft_consensus.cc:504] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:47.975494 24744 leader_election.cc:288] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:46.468043 23699 rpcz_store.cc:276] 0807 13:40:43.085407 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:43.198688 (+113281us) service_pool.cc:227] Handling call
0807 13:40:43.223697 (+ 25009us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:43.236656 (+ 12959us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:43.236695 (+ 39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:43.355381 (+118686us) spinlock_profiling.cc:243] Waited 6.88 ms on lock 0x7b2c00005cf8. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461aa90e11 00007f461aaa0442 00007f461c0e8c11 00007f461c0ad58a 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772
0807 13:40:43.384020 (+ 28639us) log.cc:842] Serialized 26 byte log entry
0807 13:40:43.750586 (+366566us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:43.766408 (+ 15822us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:43.769959 (+ 3551us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:44.891112 (+1121153us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b44000232cc. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f4619097a95 00007f46190984b2 00007f461bd40511 00007f461bd3be1a 00007f461bd2fbee 00007f461bd2ef36 00007f461bd2eb58 00007f461bd38551 00007f461bd38509 00007f461bd38499
0807 13:40:46.171090 (+1279978us) raft_consensus.cc:1671] finished
0807 13:40:46.172316 (+ 1226us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:46.205596 (+ 33280us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3919,"raft.queue_time_us":13006,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":130,"spinlock_wait_cycles":46712448,"thread_start_us":314827,"threads_started":1,"wal-append.queue_time_us":513008,"wal-append.run_cpu_time_us":35825,"wal-append.run_wall_time_us":3393043}
W20260807 13:40:47.973012 23711 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 234) took 1888 ms (client timeout 1796 ms). Trace:
I20260807 13:40:47.976166 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:47.976753 23711 rpcz_store.cc:269] 0807 13:40:46.085005 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:47.972766 (+1887761us) service_pool.cc:214] Skipping call since client already timed out
0807 13:40:47.972933 (+ 167us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260807 13:40:47.893968 23660 leader_election.cc:302] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
W20260807 13:40:47.895836 24761 log.cc:924] Time spent T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da: Append to log took a long time: real 0.180s user 0.001s sys 0.000s
I20260807 13:40:47.842293 24723 raft_consensus.cc:482] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:46.484809 23813 rpcz_store.cc:276] 0807 13:40:44.749046 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:44.751292 (+ 2246us) service_pool.cc:227] Handling call
0807 13:40:44.751780 (+ 488us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:44.787196 (+ 35416us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:44.790414 (+ 3218us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:45.461934 (+671520us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b2c000983f8. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461aa90e11 00007f461aaa0442 00007f461c0e8c11 00007f461c0ad58a 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772
0807 13:40:45.466798 (+ 4864us) log.cc:842] Serialized 26 byte log entry
0807 13:40:46.211830 (+745032us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:46.211872 (+ 42us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:46.211952 (+ 80us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:46.212002 (+ 50us) raft_consensus.cc:1671] finished
0807 13:40:46.212016 (+ 14us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:46.233995 (+ 21979us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":15995,"raft.queue_time_us":24941,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":97,"spinlock_wait_cycles":32916352,"thread_start_us":744125,"threads_started":1,"wal-append.queue_time_us":652425,"wal-append.run_cpu_time_us":24120,"wal-append.run_wall_time_us":1169230}
W20260807 13:40:47.731330 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 173271us
I20260807 13:40:47.839558 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 472) took 2796 ms. Trace:
W20260807 13:40:47.867256 24729 log.cc:924] Time spent T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 1.768s user 0.015s sys 0.002s
I20260807 13:40:47.854285 24666 raft_consensus.cc:3037] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:47.160148 24739 raft_consensus.cc:504] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:47.843014 24502 leader_election.cc:288] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:47.864058 24499 raft_consensus.cc:482] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:47.853395 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:47.763607 24722 raft_consensus.cc:504] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:47.898944 24496 consensus_queue.cc:1035] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:47.869728 24733 raft_consensus.cc:3037] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:46.845892 24676 leader_election.cc:288] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:47.898800 23710 rpcz_store.cc:269] 0807 13:40:45.406354 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:47.608665 (+2202311us) service_pool.cc:214] Skipping call since client already timed out
0807 13:40:47.652583 (+ 43918us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260807 13:40:47.904505 23888 ts_tablet_manager.cc:1460] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812: Tablet startup took 1532ms
I20260807 13:40:47.864390 24768 raft_consensus.cc:482] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:47.915786 23449 catalog_manager.cc:5495] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 1 to 2, leader changed from 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66) to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 2 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:47.899741 23590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 461) took 1826 ms. Trace:
I20260807 13:40:47.914568 23881 consensus_queue.cc:260] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:47.899035 23812 rpcz_store.cc:276] 0807 13:40:46.492594 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:46.495038 (+ 2444us) service_pool.cc:227] Handling call
0807 13:40:47.844271 (+1349233us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":898816}
I20260807 13:40:47.875257 23814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45370 (request call id 211) took 1382 ms. Trace:
I20260807 13:40:47.903452 24623 leader_election.cc:288] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:47.851852 23594 rpcz_store.cc:269] 0807 13:40:43.893019 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:43.893126 (+ 107us) service_pool.cc:227] Handling call
0807 13:40:47.553767 (+3660641us) spinlock_profiling.cc:243] Waited 2.17 s on lock 0x7b54003363d4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:40:47.572159 (+ 18392us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4979859840}
I20260807 13:40:47.842629 23818 rpcz_store.cc:276] 0807 13:40:46.473732 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:46.479193 (+ 5461us) service_pool.cc:227] Handling call
0807 13:40:47.563414 (+1084221us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:47.899997 24742 raft_consensus.cc:2726] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:47.905591 24611 raft_consensus.cc:482] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:47.915303 24643 raft_consensus.cc:3037] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:46.560496 23709 rpcz_store.cc:276] 0807 13:40:43.982187 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:43.982355 (+ 168us) service_pool.cc:227] Handling call
0807 13:40:43.982845 (+ 490us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:43.983107 (+ 262us) raft_consensus.cc:1520] Early marking committed up to index 2
0807 13:40:44.436872 (+453765us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b44000232cc. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f4619097a95 00007f46190984b2 00007f461bd40511 00007f461bd3be1a 00007f46191675fe 00007f4621f9ea39 00007f46191848bb 00007f4619182cbf 00007f4619182155 00007f461fa82167
0807 13:40:44.788953 (+352081us) log.cc:842] Serialized 14 byte log entry
0807 13:40:46.383584 (+1594631us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:46.387406 (+ 3822us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:40:46.403387 (+ 15981us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:46.414032 (+ 10645us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:46.421502 (+ 7470us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8898,"prepare.queue_time_us":864721,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":48365,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":39479,"spinlock_wait_cycles":56767360,"thread_start_us":2324050,"threads_started":3,"wal-append.queue_time_us":1295698,"wal-append.run_cpu_time_us":2899,"wal-append.run_wall_time_us":1443611}
I20260807 13:40:47.907586 24759 raft_consensus.cc:482] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:40:47.894985 23700 rpcz_store.cc:269] 0807 13:40:45.199917 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:46.502934 (+1303017us) service_pool.cc:227] Handling call
0807 13:40:47.751402 (+1248468us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:48.016083 24632 leader_election.cc:288] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:47.913062 24519 leader_election.cc:288] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:47.910518 24707 leader_election.cc:288] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:47.906358 24583 raft_consensus.cc:504] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:47.939350 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:47.939491 23707 rpcz_store.cc:269] 0807 13:40:45.405502 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:47.720415 (+2314913us) service_pool.cc:214] Skipping call since client already timed out
0807 13:40:47.720593 (+ 178us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260807 13:40:47.815474 24703 raft_consensus.cc:482] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:40:47.977699 23711 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 230) took 1899 ms (client timeout 1854 ms). Trace:
I20260807 13:40:47.977205 23597 raft_consensus.cc:2454] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
W20260807 13:40:48.035759 23711 rpcz_store.cc:269] 0807 13:40:46.078691 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:47.977535 (+1898844us) service_pool.cc:214] Skipping call since client already timed out
0807 13:40:47.977647 (+ 112us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260807 13:40:47.926415 24586 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.238s user 0.019s sys 0.045s
I20260807 13:40:47.984887 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:47.983999 24714 leader_election.cc:288] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:47.975206 24702 consensus_queue.cc:237] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:47.986387 23662 leader_election.cc:302] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
W20260807 13:40:48.040427 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 54121.9us
I20260807 13:40:48.041528 23662 leader_election.cc:302] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:47.907702 24641 raft_consensus.cc:504] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:47.989178 24610 leader_election.cc:288] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:47.926537 23884 ts_tablet_manager.cc:1462] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37: Trace:
0807 13:40:26.056928 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:27.121170 (+1064242us) service_pool.cc:227] Handling call
0807 13:40:27.152629 (+ 31459us) spinlock_profiling.cc:243] Waited 7.71 ms on lock 0x7b5800004598. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462105bd21 00007f46210391e3 00007f4620fea869 00007f461a5ecc44 00007f461a5ecbd2 00007f461a5ecb01
0807 13:40:27.203487 (+ 50858us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:27.207611 (+ 4124us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:27.230176 (+ 22565us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:27.308789 (+ 78613us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:27.309259 (+ 470us) inbound_call.cc:173] Queueing success response
0807 13:40:44.227881 (+16918622us) ts_tablet_manager.cc:1373] Bootstrapping tablet
0807 13:40:46.374097 (+2146216us) ts_tablet_manager.cc:1429] Starting tablet replica
0807 13:40:46.531043 (+156946us) tablet_replica.cc:259] Starting instrumentation
0807 13:40:46.531741 (+ 698us) tablet_replica.cc:278] Starting consensus
Metrics: {"mutex_wait_us":38902,"raft.queue_time_us":119943,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":22169,"spinlock_wait_cycles":17736064,"tablet-open.queue_time_us":16918698,"thread_start_us":236204,"threads_started":1}
W20260807 13:40:47.980636 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 86830.2us
I20260807 13:40:48.044551 23660 leader_election.cc:302] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:48.044562 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:48.045130 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:48.045405 23711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 488) took 1571 ms. Trace:
I20260807 13:40:48.045588 23707 raft_consensus.cc:2454] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:48.045944 23707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 236) took 1560 ms. Trace:
I20260807 13:40:48.045758 23711 rpcz_store.cc:276] 0807 13:40:46.474187 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:48.036542 (+1562355us) service_pool.cc:227] Handling call
0807 13:40:48.045350 (+ 8808us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:48.046226 23707 rpcz_store.cc:276] 0807 13:40:46.485462 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:48.035037 (+1549575us) service_pool.cc:227] Handling call
0807 13:40:48.045908 (+ 10871us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:48.046980 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:48.047420 23707 raft_consensus.cc:2454] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:48.047688 23707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 489) took 1573 ms. Trace:
I20260807 13:40:48.047850 23707 rpcz_store.cc:276] 0807 13:40:46.474537 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:48.046763 (+1572226us) service_pool.cc:227] Handling call
0807 13:40:48.047659 (+ 896us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:47.925647 23817 rpcz_store.cc:276] 0807 13:40:46.477584 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:46.479886 (+ 2302us) service_pool.cc:227] Handling call
0807 13:40:46.804625 (+324739us) spinlock_profiling.cc:243] Waited 5.43 ms on lock 0x7b5800255098. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f4620fef1b0 00007f4620feea94 00007f461a6d6c04 00007f461a6d6b92
0807 13:40:47.753810 (+949185us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":12482816}
I20260807 13:40:47.963248 24637 raft_consensus.cc:482] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:47.936730 24760 raft_consensus.cc:3037] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:48.002513 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4062e0223a4cc0b2e448e35445671d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:47.975888 23588 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 420) took 1890 ms (client timeout 1745 ms). Trace:
I20260807 13:40:47.975221 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:48.056802 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:48.056896 23823 raft_consensus.cc:2454] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 0.
I20260807 13:40:48.006266 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:48.008961 23600 raft_consensus.cc:1226] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:47.989909 24709 leader_election.cc:288] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:48.011135 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:47.989283 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4062e0223a4cc0b2e448e35445671d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:48.010150 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 78435.8us
I20260807 13:40:47.991673 24544 raft_consensus.cc:2781] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:48.013650 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:48.060204 23601 raft_consensus.cc:2454] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:48.015252 23591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 416) took 1943 ms. Trace:
I20260807 13:40:47.976060 24648 raft_consensus.cc:504] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:48.027508 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:48.027662 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:48.027995 24752 leader_election.cc:288] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:48.030344 23881 ts_tablet_manager.cc:1428] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.337s user 0.009s sys 0.002s
I20260807 13:40:47.900471 24708 consensus_queue.cc:1035] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260807 13:40:48.013236 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:48.015175 23888 ts_tablet_manager.cc:1462] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812: Trace:
0807 13:40:26.298362 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:27.112055 (+813693us) service_pool.cc:227] Handling call
0807 13:40:27.114069 (+ 2014us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:40:27.114182 (+ 113us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:40:27.166705 (+ 52523us) tablet_metadata.cc:641] Metadata flushed
0807 13:40:27.273568 (+106863us) tablet_replica.cc:205] Creating consensus instance
0807 13:40:27.274070 (+ 502us) inbound_call.cc:173] Queueing success response
0807 13:40:43.877671 (+16603601us) ts_tablet_manager.cc:1373] Bootstrapping tablet
0807 13:40:46.372400 (+2494729us) ts_tablet_manager.cc:1429] Starting tablet replica
0807 13:40:46.730970 (+358570us) tablet_replica.cc:259] Starting instrumentation
0807 13:40:46.770260 (+ 39290us) tablet_replica.cc:278] Starting consensus
Metrics: {"mutex_wait_us":5176,"raft.queue_time_us":25271,"raft.run_cpu_time_us":7230,"raft.run_wall_time_us":51420,"tablet-open.queue_time_us":16603681}
I20260807 13:40:48.021943 24653 raft_consensus.cc:482] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:48.022033 23814 rpcz_store.cc:276] 0807 13:40:46.493245 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:47.467213 (+973968us) service_pool.cc:227] Handling call
0807 13:40:47.636845 (+169632us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:47.812227 (+175382us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:47.867003 (+ 54776us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:48.043963 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9552d42b445450691daef21fba4059a" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:48.017900 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:48.007429 24499 raft_consensus.cc:504] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:48.025874 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:48.038265 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4062e0223a4cc0b2e448e35445671d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:48.038971 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:47.989802 23704 rpcz_store.cc:276] 0807 13:40:45.020018 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:45.021447 (+ 1429us) service_pool.cc:227] Handling call
0807 13:40:45.039093 (+ 17646us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:45.193769 (+154676us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:45.216428 (+ 22659us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:45.384006 (+167578us) log.cc:842] Serialized 26 byte log entry
0807 13:40:46.395749 (+1011743us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:46.395792 (+ 43us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:46.395884 (+ 92us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:47.806822 (+1410938us) raft_consensus.cc:1671] finished
0807 13:40:47.806848 (+ 26us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:47.816748 (+ 9900us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":37542,"raft.queue_time_us":41334,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":160799,"thread_start_us":290493,"threads_started":1,"wal-append.queue_time_us":458409}
I20260807 13:40:48.049862 23662 leader_election.cc:302] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:48.042766 24703 raft_consensus.cc:504] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:48.033363 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:48.048910 24610 raft_consensus.cc:2781] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:48.039388 24747 leader_election.cc:288] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:48.063149 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:48.144265 23594 raft_consensus.cc:2454] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:48.145679 24499 leader_election.cc:288] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:48.146454 23820 raft_consensus.cc:2454] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:48.146682 24610 raft_consensus.cc:482] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:48.147055 24610 raft_consensus.cc:3037] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:48.147432 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:48.049602 23595 raft_consensus.cc:2454] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:48.050866 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:47.991194 24723 raft_consensus.cc:504] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:48.031577 24611 raft_consensus.cc:504] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:48.057796 23711 raft_consensus.cc:2454] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:48.064594 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:48.148078 23820 raft_consensus.cc:2454] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:48.154254 23711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 242) took 1656 ms. Trace:
I20260807 13:40:48.154691 23600 raft_consensus.cc:2454] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:48.148680 23597 raft_consensus.cc:2454] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:48.154963 23711 rpcz_store.cc:276] 0807 13:40:46.497700 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:48.046542 (+1548842us) service_pool.cc:227] Handling call
0807 13:40:48.154199 (+107657us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:48.058732 23703 raft_consensus.cc:2454] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:48.049444 24623 raft_consensus.cc:2781] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260807 13:40:48.149096 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 99290.7us
I20260807 13:40:48.157809 23662 leader_election.cc:302] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:48.155094 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:48.019932 23590 rpcz_store.cc:276] 0807 13:40:46.073677 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:46.134619 (+ 60942us) service_pool.cc:227] Handling call
0807 13:40:46.134971 (+ 352us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:47.899422 (+1764451us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:47.899678 (+ 256us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:48.049314 24519 raft_consensus.cc:2726] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:48.119935 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:48.128736 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:48.163549 23823 raft_consensus.cc:2454] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
W20260807 13:40:48.156455 23703 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 490) took 1681 ms (client timeout 1589 ms). Trace:
I20260807 13:40:48.138437 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:48.022316 24768 raft_consensus.cc:504] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:48.160617 23662 leader_election.cc:302] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:48.161554 23597 raft_consensus.cc:1261] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260807 13:40:48.164958 23703 rpcz_store.cc:269] 0807 13:40:46.474828 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:47.990163 (+1515335us) service_pool.cc:227] Handling call
0807 13:40:48.156405 (+166242us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:48.165405 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:48.166041 23597 raft_consensus.cc:2454] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:48.166525 23707 raft_consensus.cc:2379] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:48.166767 23662 leader_election.cc:302] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:48.058324 24651 leader_election.cc:288] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:48.167943 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:48.164588 23601 raft_consensus.cc:2454] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:48.037989 24759 raft_consensus.cc:504] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:48.171442 23815 raft_consensus.cc:2454] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:48.171991 24745 leader_election.cc:288] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:48.172647 24765 raft_consensus.cc:2726] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:48.072968 24544 raft_consensus.cc:482] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:40:48.172909 23700 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 240) took 1675 ms (client timeout 2170 ms). Trace:
I20260807 13:40:48.173420 24544 raft_consensus.cc:3037] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:48.174021 24583 leader_election.cc:288] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:48.123047 24719 leader_election.cc:288] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:48.188120 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:48.141185 24739 leader_election.cc:288] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:48.187839 23662 connection.cc:232] RPC call timeout handler was delayed by -1.8927224630024284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
I20260807 13:40:48.151578 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:48.153445 24752 raft_consensus.cc:2726] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 13:40:48.191641 23662 connection.cc:232] RPC call timeout handler was delayed by -1.6470224629156291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20179999999999998s for a response
I20260807 13:40:48.194685 24723 leader_election.cc:288] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:40:48.197489 23535 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:40:48.201555 23662 leader_election.cc:302] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:48.202700 24771 raft_consensus.cc:2781] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:48.203294 24771 raft_consensus.cc:482] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:48.203884 24771 raft_consensus.cc:3037] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:48.153189 24649 leader_election.cc:288] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:48.156930 24653 raft_consensus.cc:504] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:48.162092 24623 raft_consensus.cc:482] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:48.210817 24623 raft_consensus.cc:3037] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:48.210996 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:48.063686 24727 leader_election.cc:288] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:48.161684 24721 leader_election.cc:288] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:48.163661 24667 raft_consensus.cc:3037] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:48.212162 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:48.063428 23699 raft_consensus.cc:2454] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:48.169193 24605 raft_consensus.cc:2781] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:48.290526 23703 raft_consensus.cc:2454] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:48.059157 24637 raft_consensus.cc:504] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:48.186964 24547 raft_consensus.cc:2781] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260807 13:40:48.059178 23588 rpcz_store.cc:269] 0807 13:40:46.072511 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:46.072652 (+ 141us) service_pool.cc:227] Handling call
0807 13:40:46.803236 (+730584us) spinlock_profiling.cc:243] Waited 4.6 ms on lock 0x7b5800001898. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f4620fef1b0 00007f4620feea94 00007f461a6d6c04 00007f461a6d6b92
0807 13:40:47.938471 (+1135235us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":10580736}
I20260807 13:40:48.107424 23821 raft_consensus.cc:2454] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:48.172942 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:48.190089 24765 raft_consensus.cc:482] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:48.190531 24519 raft_consensus.cc:482] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:48.189910 23825 raft_consensus.cc:2454] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
W20260807 13:40:48.206899 23705 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 241) took 1709 ms (client timeout 2056 ms). Trace:
I20260807 13:40:48.311722 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:48.213086 24722 leader_election.cc:288] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:48.178261 24726 consensus_queue.cc:1035] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.125s
W20260807 13:40:48.182873 23700 rpcz_store.cc:269] 0807 13:40:46.497074 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:48.035600 (+1538526us) service_pool.cc:227] Handling call
0807 13:40:48.172792 (+137192us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:48.316684 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:48.289722 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9552d42b445450691daef21fba4059a" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:48.287959 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:48.312705 23823 raft_consensus.cc:1261] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:48.306270 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:48.289407 23813 raft_consensus.cc:2454] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:48.292654 24665 leader_election.cc:288] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:48.176498 24754 raft_consensus.cc:504] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:48.207149 23710 raft_consensus.cc:2454] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:48.296077 24605 raft_consensus.cc:482] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:48.297598 24547 raft_consensus.cc:482] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:40:48.301507 23699 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 491) took 1823 ms (client timeout 1816 ms). Trace:
I20260807 13:40:48.313736 24709 raft_consensus.cc:482] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:48.343938 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:48.345335 23823 raft_consensus.cc:2454] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:48.314450 23815 raft_consensus.cc:2454] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:48.320068 23812 raft_consensus.cc:2454] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 0.
I20260807 13:40:48.326937 24547 raft_consensus.cc:3037] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:48.367060 23772 leader_election.cc:302] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:48.061080 23591 rpcz_store.cc:276] 0807 13:40:46.070899 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:46.080880 (+ 9981us) service_pool.cc:227] Handling call
0807 13:40:46.800021 (+719141us) spinlock_profiling.cc:243] Waited 7.07 ms on lock 0x7b5800001898. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f46210032b0 00007f4620fee7f9 00007f4620fee2a2 00007f461a6d4684
0807 13:40:46.800393 (+ 372us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:47.904934 (+1104541us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:48.003213 (+ 98279us) spinlock_profiling.cc:243] Waited 837 ms on lock 0x7b54000e4554. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:40:48.014148 (+ 10935us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1940593408}
I20260807 13:40:48.325897 24605 raft_consensus.cc:3037] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:40:48.315742 23705 rpcz_store.cc:269] 0807 13:40:46.497373 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:47.992164 (+1494791us) service_pool.cc:227] Handling call
0807 13:40:48.190378 (+198214us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:48.316237 24723 consensus_queue.cc:1035] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260807 13:40:48.340261 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:48.318473 24519 raft_consensus.cc:504] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:48.408552 23703 raft_consensus.cc:2454] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:48.327531 23814 raft_consensus.cc:2454] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:48.370857 23772 leader_election.cc:302] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:48.409539 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:48.410287 23601 raft_consensus.cc:3037] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:48.326478 23817 raft_consensus.cc:2454] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:48.413072 23772 leader_election.cc:302] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:48.372349 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:48.405601 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:48.318141 24765 raft_consensus.cc:504] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:48.429807 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:48.366433 23594 raft_consensus.cc:1226] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:48.332983 24722 consensus_queue.cc:1035] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260807 13:40:48.352376 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:48.368084 24759 leader_election.cc:288] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:48.342814 24632 consensus_queue.cc:1035] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260807 13:40:48.447351 23601 raft_consensus.cc:2454] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
W20260807 13:40:48.333860 23699 rpcz_store.cc:269] 0807 13:40:46.475096 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:47.988927 (+1513831us) service_pool.cc:227] Handling call
0807 13:40:48.298941 (+310014us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:48.434768 23588 raft_consensus.cc:2454] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:48.412730 24773 raft_consensus.cc:2781] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:48.400800 24641 leader_election.cc:288] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:48.443166 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:48.444103 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c1184114b02410098331e68d3b8d4cf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:48.454491 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:48.471015 23598 raft_consensus.cc:3037] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:48.434023 23817 raft_consensus.cc:1226] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:48.484808 23554 leader_election.cc:302] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
W20260807 13:40:48.465552 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 52562.8us
I20260807 13:40:48.431974 24648 leader_election.cc:288] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:48.461952 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:48.493351 23601 raft_consensus.cc:2454] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
W20260807 13:40:48.478307 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 124778us
I20260807 13:40:48.435662 23812 raft_consensus.cc:1261] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:48.352332 24709 raft_consensus.cc:504] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:48.434247 24721 raft_consensus.cc:2781] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:48.486227 23772 leader_election.cc:302] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:48.454843 23700 raft_consensus.cc:2454] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:48.491628 23554 leader_election.cc:302] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:48.503619 23772 leader_election.cc:302] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:48.446506 24747 consensus_queue.cc:1046] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.046s
W20260807 13:40:48.489941 23769 connection.cc:232] RPC call timeout handler was delayed by -1.2942606459837407s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2262s for a response
I20260807 13:40:48.470038 24611 leader_election.cc:288] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:48.480473 24499 raft_consensus.cc:2781] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:48.506485 23772 leader_election.cc:302] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:48.508975 23554 leader_election.cc:302] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:48.468068 24773 raft_consensus.cc:482] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:48.515796 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:48.513204 24651 raft_consensus.cc:2781] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:48.512732 24499 raft_consensus.cc:482] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:48.516530 24651 raft_consensus.cc:482] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:48.517032 24499 raft_consensus.cc:3037] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:48.517108 24651 raft_consensus.cc:3037] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:48.517457 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:48.491356 23815 raft_consensus.cc:2454] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:48.513072 24702 raft_consensus.cc:2781] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:48.519150 24702 raft_consensus.cc:482] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:48.519613 24702 raft_consensus.cc:3037] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:48.519788 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:48.521499 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:48.523162 23554 leader_election.cc:302] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:48.462787 24727 consensus_queue.cc:1035] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260807 13:40:48.528123 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:48.499452 24752 raft_consensus.cc:482] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:48.531867 23601 raft_consensus.cc:2454] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:48.462924 24708 consensus_queue.cc:1035] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260807 13:40:48.498750 24719 raft_consensus.cc:2781] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:48.505143 24721 raft_consensus.cc:482] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:48.510226 24759 raft_consensus.cc:482] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:40:48.522590 24758 consensus_meta.cc:287] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.877s user 0.009s sys 0.007s
I20260807 13:40:48.511053 24583 raft_consensus.cc:2781] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:48.531391 24714 raft_consensus.cc:2781] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:48.527297 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:48.542827 24632 consensus_queue.cc:1035] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:48.543478 24754 leader_election.cc:288] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:48.532099 24662 raft_consensus.cc:2781] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:48.522379 23815 raft_consensus.cc:3037] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:48.522529 24773 raft_consensus.cc:3037] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:48.527204 24723 raft_consensus.cc:3032] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:48.563217 23772 leader_election.cc:302] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:48.530499 24641 raft_consensus.cc:2781] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:48.542865 24703 leader_election.cc:288] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:48.541191 24721 raft_consensus.cc:3037] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:48.542881 24586 consensus_queue.cc:1035] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:48.534693 24765 leader_election.cc:288] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:48.540469 24637 leader_election.cc:288] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:48.579370 24768 leader_election.cc:288] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:48.536639 24719 raft_consensus.cc:482] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:48.533782 23705 raft_consensus.cc:2396] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 13:40:48.538071 24752 raft_consensus.cc:504] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:48.569983 24758 raft_consensus.cc:504] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:48.562248 24714 raft_consensus.cc:482] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:48.577507 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:48.562371 24583 raft_consensus.cc:482] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:48.540248 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac6e18ecd14ba2a7d3e846a9fc81bf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:48.605726 23702 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 239) took 2095 ms (client timeout 1979 ms). Trace:
I20260807 13:40:48.566567 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4062e0223a4cc0b2e448e35445671d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:48.537595 24519 leader_election.cc:288] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:48.582036 24662 raft_consensus.cc:482] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:48.585608 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:48.758252 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 188802us
I20260807 13:40:48.586072 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:48.673671 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 135958us
I20260807 13:40:48.589833 24641 raft_consensus.cc:482] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:48.522445 24739 consensus_queue.cc:1035] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260807 13:40:48.577803 24747 consensus_queue.cc:1035] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260807 13:40:48.561023 24759 raft_consensus.cc:504] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:48.670146 24719 raft_consensus.cc:3037] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:48.587280 24723 raft_consensus.cc:729] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:48.760257 23554 leader_election.cc:302] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
W20260807 13:40:48.764531 24789 log.cc:924] Time spent T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.160s user 0.001s sys 0.000s
I20260807 13:40:48.761960 23769 leader_election.cc:302] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:48.695007 24714 raft_consensus.cc:3037] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:48.708982 24583 raft_consensus.cc:3037] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:48.758191 23705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 243) took 2257 ms. Trace:
I20260807 13:40:48.758407 24662 raft_consensus.cc:3037] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:48.757717 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:48.765028 24641 raft_consensus.cc:3037] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:48.754696 23699 raft_consensus.cc:2454] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:48.765784 24637 raft_consensus.cc:2781] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:48.792088 23705 rpcz_store.cc:276] 0807 13:40:46.497993 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:48.431940 (+1933947us) service_pool.cc:227] Handling call
0807 13:40:48.754934 (+322994us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:40:48.804224 24784 log.cc:924] Time spent T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.235s user 0.001s sys 0.000s
W20260807 13:40:48.804486 24643 consensus_meta.cc:287] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.772s user 0.024s sys 0.021s
I20260807 13:40:48.804854 24643 raft_consensus.cc:504] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:48.796141 23769 leader_election.cc:302] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:48.806936 24653 leader_election.cc:288] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:48.808419 24653 raft_consensus.cc:2781] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260807 13:40:48.795496 24790 log.cc:924] Time spent T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.147s user 0.000s sys 0.001s
I20260807 13:40:48.771800 23595 raft_consensus.cc:2454] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:48.803422 24637 raft_consensus.cc:482] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:48.814816 24797 raft_consensus.cc:482] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:40:48.740365 23702 rpcz_store.cc:269] 0807 13:40:46.496759 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:48.579831 (+2083072us) service_pool.cc:214] Skipping call since client already timed out
0807 13:40:48.591849 (+ 12018us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260807 13:40:48.817976 24637 raft_consensus.cc:3037] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:48.818043 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:48.820006 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:48.820511 23588 raft_consensus.cc:2454] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:48.791934 24632 raft_consensus.cc:2781] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:48.811643 23704 raft_consensus.cc:2379] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 1: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:48.821300 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:48.804503 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:48.823539 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:48.824357 24610 consensus_meta.cc:287] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.677s user 0.017s sys 0.024s
I20260807 13:40:48.808789 24653 raft_consensus.cc:482] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:40:48.811844 23710 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 244) took 1668 ms (client timeout 1517 ms). Trace:
I20260807 13:40:48.809856 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:48.836396 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 273239us
I20260807 13:40:48.813534 24709 leader_election.cc:288] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:48.845652 23598 raft_consensus.cc:2454] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:48.846316 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:48.846801 23598 raft_consensus.cc:2454] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:48.825241 24632 raft_consensus.cc:482] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
W20260807 13:40:48.847502 23709 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 238) took 2351 ms (client timeout 2243 ms). Trace:
W20260807 13:40:48.850361 23709 rpcz_store.cc:269] 0807 13:40:46.496316 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:48.838302 (+2341986us) service_pool.cc:214] Skipping call since client already timed out
0807 13:40:48.843914 (+ 5612us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260807 13:40:48.850862 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:48.851670 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:48.852141 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:48.852571 23709 raft_consensus.cc:2454] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:48.853821 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:48.853708 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c1184114b02410098331e68d3b8d4cf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:48.812464 24499 raft_consensus.cc:504] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:48.855875 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:48.836431 24610 raft_consensus.cc:504] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:48.857304 24785 log.cc:924] Time spent T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.102s user 0.001s sys 0.001s
I20260807 13:40:48.825918 24797 raft_consensus.cc:504] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:48.858258 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:48.834537 24643 leader_election.cc:288] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:48.859022 23705 raft_consensus.cc:2379] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
W20260807 13:40:48.861536 24771 consensus_meta.cc:287] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.657s user 0.014s sys 0.008s
I20260807 13:40:48.864598 23699 raft_consensus.cc:2379] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:48.864459 24557 leader_election.cc:288] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:48.841423 23710 rpcz_store.cc:269] 0807 13:40:47.143714 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:48.022562 (+878848us) service_pool.cc:227] Handling call
0807 13:40:48.811651 (+789089us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b5400071054. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:40:48.811780 (+ 129us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":71655168}
I20260807 13:40:48.865590 24758 leader_election.cc:288] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:48.832410 24723 consensus_queue.cc:260] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:48.849138 23555 leader_election.cc:302] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:48.844733 23772 leader_election.cc:302] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
W20260807 13:40:48.894999 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 50323.7us
I20260807 13:40:48.872465 23598 raft_consensus.cc:3037] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 3
I20260807 13:40:48.836911 24653 raft_consensus.cc:3037] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:48.866809 23815 raft_consensus.cc:2454] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:48.874354 24752 leader_election.cc:288] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:48.875296 24733 consensus_meta.cc:287] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.862s user 0.019s sys 0.016s
W20260807 13:40:48.876663 23704 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 247) took 1428 ms (client timeout 1772 ms). Trace:
I20260807 13:40:48.855432 23709 raft_consensus.cc:2454] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
W20260807 13:40:48.882095 23661 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:47672 dropped due to backpressure. The service queue is full; it has 50 items.
I20260807 13:40:48.881981 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:48.927054 23823 raft_consensus.cc:3037] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:48.883294 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:48.855798 24632 raft_consensus.cc:3037] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:48.847820 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:48.844444 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:48.879606 24623 consensus_meta.cc:287] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.668s user 0.014s sys 0.023s
I20260807 13:40:48.931056 23597 raft_consensus.cc:2454] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:48.891815 24771 raft_consensus.cc:504] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:48.943410 23660 leader_election.cc:302] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:49.028287 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:48.986804 23598 raft_consensus.cc:2454] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:48.983207 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:48.926070 23704 rpcz_store.cc:269] 0807 13:40:47.447781 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:48.163896 (+716115us) service_pool.cc:227] Handling call
0807 13:40:48.876358 (+712462us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b5400032854. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:40:48.876564 (+ 206us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1126377728}
I20260807 13:40:48.990984 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9552d42b445450691daef21fba4059a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
W20260807 13:40:49.031085 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 87785.2us
I20260807 13:40:48.942111 24610 leader_election.cc:288] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:49.025890 23823 raft_consensus.cc:2454] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:49.029008 23597 raft_consensus.cc:2454] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:49.033057 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:49.035980 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:48.977502 24499 leader_election.cc:288] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:49.037055 23660 leader_election.cc:302] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:49.037068 23599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 476) took 1055 ms. Trace:
W20260807 13:40:48.997112 24666 consensus_meta.cc:287] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent flushing consensus metadata: real 0.987s user 0.010s sys 0.023s
I20260807 13:40:49.037997 23599 rpcz_store.cc:276] 0807 13:40:47.981810 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:47.981976 (+ 166us) service_pool.cc:227] Handling call
0807 13:40:47.998571 (+ 16595us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:47.998919 (+ 348us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:47.998956 (+ 37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:47.999384 (+ 428us) log.cc:842] Serialized 26 byte log entry
0807 13:40:48.399498 (+400114us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b18001949e0. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f46220248b1 00007f4622031661 00007f4619167345 00007f4621f9ea39 00007f46191848bb 00007f4619182cbf 00007f4619184e22 00007f461bd2e5bb 00007f461bd34063 00007f461bd34411 00007f461c0815cf
0807 13:40:48.490923 (+ 91425us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:40:48.490972 (+ 49us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:48.491054 (+ 82us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:48.899379 (+408325us) raft_consensus.cc:1671] finished
0807 13:40:48.899400 (+ 21us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:49.036989 (+137589us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":106,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":6815,"spinlock_wait_cycles":2730368,"thread_start_us":90981,"threads_started":1,"wal-append.queue_time_us":529044}
I20260807 13:40:48.924513 24800 raft_consensus.cc:2781] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:49.040391 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:49.041386 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:49.043593 23597 raft_consensus.cc:2454] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:48.983777 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:48.984839 24583 raft_consensus.cc:504] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.048668 24797 leader_election.cc:288] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:49.008654 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:49.050202 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:49.034916 24752 raft_consensus.cc:2781] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:49.045343 24666 raft_consensus.cc:504] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.045540 24800 raft_consensus.cc:482] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:48.972252 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:48.971127 23702 raft_consensus.cc:2454] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:48.972739 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4062e0223a4cc0b2e448e35445671d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:49.093271 23588 raft_consensus.cc:2454] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:49.094738 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:49.095444 23591 raft_consensus.cc:2454] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:49.096401 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:49.096768 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:49.097621 24632 raft_consensus.cc:504] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.098052 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:49.098410 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:49.098974 23825 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 223) took 1441 ms (client timeout 1796 ms). Trace:
I20260807 13:40:49.099488 23710 raft_consensus.cc:2454] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
W20260807 13:40:49.099378 23825 rpcz_store.cc:269] 0807 13:40:47.658081 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:47.897453 (+239372us) service_pool.cc:227] Handling call
0807 13:40:49.098813 (+1201360us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54003af554. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:40:49.098918 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":643155712}
I20260807 13:40:49.100282 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:49.100747 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:49.100930 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:49.101327 23699 raft_consensus.cc:2454] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:49.102641 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:49.103979 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:49.104149 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:49.053368 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f8a5f186bf1473a988921e5efa3e574" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:49.055233 24804 log.cc:924] Time spent T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.069s user 0.000s sys 0.000s
I20260807 13:40:49.054862 24752 raft_consensus.cc:686] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:49.058694 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:49.105370 23597 raft_consensus.cc:2454] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:49.095460 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:48.938184 23661 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:47672 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 270)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 271)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 254)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 255)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 256)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 499)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 494)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 514)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 260)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 510)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 513)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 262)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 259)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 504)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 511)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 512)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 477)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 478)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 479)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 481)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 482)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 209)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 210)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 222)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 483)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 484)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 231)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 232)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 487)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 237)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 257)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 492)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 493)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 496)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 501)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 502)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 503)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 507)
I20260807 13:40:48.930889 24733 raft_consensus.cc:504] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.051815 23594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 486) took 1019 ms. Trace:
W20260807 13:40:49.071323 24791 log.cc:924] Time spent T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.391s user 0.005s sys 0.000s
W20260807 13:40:49.073419 24547 consensus_meta.cc:287] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.694s user 0.022s sys 0.002s
W20260807 13:40:49.074607 24544 consensus_meta.cc:287] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.900s user 0.011s sys 0.010s
I20260807 13:40:49.075192 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:49.076607 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 316438us
I20260807 13:40:49.111387 23554 leader_election.cc:302] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:49.111986 23554 leader_election.cc:302] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:49.077175 24739 raft_consensus.cc:2781] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260807 13:40:49.078301 24702 consensus_meta.cc:287] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.558s user 0.003s sys 0.029s
I20260807 13:40:49.110782 23707 raft_consensus.cc:2454] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:49.103513 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9552d42b445450691daef21fba4059a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:49.113862 23554 leader_election.cc:302] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
W20260807 13:40:49.114022 23707 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 251) took 1533 ms (client timeout 1875 ms). Trace:
W20260807 13:40:49.114367 23707 rpcz_store.cc:269] 0807 13:40:47.580601 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:48.192751 (+612150us) service_pool.cc:227] Handling call
0807 13:40:49.075035 (+882284us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b5800004598. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f4620fef1b0 00007f4620feea94 00007f461a6d6c04 00007f461a6d6b92
0807 13:40:49.113962 (+ 38927us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":35730816}
I20260807 13:40:49.079934 24759 leader_election.cc:288] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:49.080716 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c1184114b02410098331e68d3b8d4cf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:49.081758 24651 consensus_meta.cc:287] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812: Time spent flushing consensus metadata: real 0.564s user 0.010s sys 0.010s
I20260807 13:40:49.081938 24714 raft_consensus.cc:504] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.083179 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:49.083225 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 234122us
I20260807 13:40:49.067346 24800 raft_consensus.cc:3037] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:49.118221 23555 leader_election.cc:302] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:49.117260 24709 raft_consensus.cc:2781] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:49.112604 24547 raft_consensus.cc:504] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
W20260807 13:40:49.085222 24760 consensus_meta.cc:287] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent flushing consensus metadata: real 0.984s user 0.006s sys 0.013s
W20260807 13:40:49.084362 24748 consensus_meta.cc:287] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 1.159s user 0.033s sys 0.019s
I20260807 13:40:49.085705 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 245) took 1659 ms. Trace:
I20260807 13:40:49.119560 23820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 232) took 1266 ms. Trace:
I20260807 13:40:49.120041 24795 raft_consensus.cc:2781] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:49.113420 24544 raft_consensus.cc:504] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.123697 24795 raft_consensus.cc:482] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:49.123579 23820 rpcz_store.cc:276] 0807 13:40:47.852887 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:48.189681 (+336794us) service_pool.cc:227] Handling call
0807 13:40:49.080559 (+890878us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b5800255098. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f4620fef1b0 00007f4620feea94 00007f461a6d6c04 00007f461a6d6b92
0807 13:40:49.119500 (+ 38941us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":38015232}
I20260807 13:40:49.124341 24795 raft_consensus.cc:3037] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:49.125465 24547 leader_election.cc:288] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Requested vote from peers d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685), 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187)
I20260807 13:40:49.125867 23700 raft_consensus.cc:2379] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:49.125516 24748 raft_consensus.cc:504] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.125950 24544 leader_election.cc:288] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:49.122385 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:49.127378 23825 raft_consensus.cc:3037] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:49.086853 24641 raft_consensus.cc:504] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.124855 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:49.115367 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:49.131011 24641 leader_election.cc:288] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:49.132040 23555 leader_election.cc:302] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
W20260807 13:40:49.132302 24667 consensus_meta.cc:287] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812: Time spent flushing consensus metadata: real 0.837s user 0.010s sys 0.024s
I20260807 13:40:49.132882 24649 raft_consensus.cc:482] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:49.132977 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:49.133425 23555 leader_election.cc:302] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:49.133566 24649 raft_consensus.cc:504] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.097658 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:49.134263 24727 raft_consensus.cc:2781] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:49.134917 24727 raft_consensus.cc:482] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:49.106976 23594 rpcz_store.cc:276] 0807 13:40:48.024604 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:48.145428 (+120824us) service_pool.cc:227] Handling call
0807 13:40:48.145918 (+ 490us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:48.445953 (+300035us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:49.037948 (+591995us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b540016f8d4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:40:49.044013 (+ 6065us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":447812480}
I20260807 13:40:49.135579 24727 raft_consensus.cc:3037] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:49.136130 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:49.137494 23594 raft_consensus.cc:2379] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 3: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:49.138378 24723 raft_consensus.cc:3037] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:49.139168 23594 raft_consensus.cc:1226] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:49.119391 24752 consensus_queue.cc:237] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.130602 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:49.026590 24623 raft_consensus.cc:504] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.088552 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:49.143074 24760 raft_consensus.cc:504] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.144237 23821 raft_consensus.cc:2454] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:49.144923 23590 raft_consensus.cc:1226] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:49.145525 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c1184114b02410098331e68d3b8d4cf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:49.146188 24760 leader_election.cc:288] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:49.091382 23813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 230) took 1339 ms. Trace:
I20260807 13:40:49.143813 23600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 490) took 1100 ms. Trace:
I20260807 13:40:49.146819 23813 rpcz_store.cc:276] 0807 13:40:47.752531 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:47.996405 (+243874us) service_pool.cc:227] Handling call
0807 13:40:49.091132 (+1094727us) spinlock_profiling.cc:243] Waited 57 ms on lock 0x7b54002e27d4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:40:49.091287 (+ 155us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":131123968}
I20260807 13:40:49.090296 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:49.148679 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:49.090616 24653 raft_consensus.cc:504] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.149747 23813 raft_consensus.cc:2379] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 2: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:49.115795 24586 raft_consensus.cc:2781] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:49.147181 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:49.151388 24586 raft_consensus.cc:482] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:49.151762 24653 leader_election.cc:288] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:49.151976 24586 raft_consensus.cc:3037] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:49.152532 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:49.154740 23598 raft_consensus.cc:2379] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 3: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:49.154498 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:49.128655 24662 raft_consensus.cc:504] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.155316 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:49.122031 23601 raft_consensus.cc:2379] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 3: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
W20260807 13:40:49.089874 24605 consensus_meta.cc:287] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.690s user 0.012s sys 0.029s
I20260807 13:40:49.042835 23595 raft_consensus.cc:3037] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:40:49.107259 23711 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 249) took 1534 ms (client timeout 1698 ms). Trace:
I20260807 13:40:49.106693 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:49.108438 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:49.116258 23554 leader_election.cc:302] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:49.117480 24742 raft_consensus.cc:2781] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:49.083865 24557 raft_consensus.cc:2781] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:49.119391 24709 raft_consensus.cc:482] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:49.134132 23699 raft_consensus.cc:2379] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 3: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:49.201973 23772 leader_election.cc:302] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:49.127386 23703 rpcz_store.cc:276] 0807 13:40:47.426221 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:48.316443 (+890222us) service_pool.cc:227] Handling call
0807 13:40:49.085549 (+769106us) spinlock_profiling.cc:243] Waited 91.2 ms on lock 0x7b54001612d4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:40:49.085647 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":209762176}
I20260807 13:40:49.117290 24702 raft_consensus.cc:504] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.088111 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:49.053743 24610 raft_consensus.cc:2781] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:48.984244 24773 raft_consensus.cc:504] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.088003 24719 raft_consensus.cc:504] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.122184 24733 leader_election.cc:288] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:49.152851 23709 raft_consensus.cc:2379] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:49.091588 24771 leader_election.cc:288] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:49.162384 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:49.196794 24557 raft_consensus.cc:482] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:49.135911 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:49.191295 23662 leader_election.cc:302] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
W20260807 13:40:49.277976 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 86747.2us
I20260807 13:40:49.279012 23662 leader_election.cc:302] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:49.280532 23662 leader_election.cc:302] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:49.282020 23662 leader_election.cc:302] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:49.170691 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:49.147804 23600 rpcz_store.cc:276] 0807 13:40:48.043853 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:48.162693 (+118840us) service_pool.cc:227] Handling call
0807 13:40:48.191262 (+ 28569us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:48.207899 (+ 16637us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:48.207940 (+ 41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:48.287324 (+ 79384us) log.cc:842] Serialized 26 byte log entry
0807 13:40:48.501935 (+214611us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:40:48.539004 (+ 37069us) log.cc:842] Serialized 14 byte log entry
0807 13:40:49.058850 (+519846us) spinlock_profiling.cc:243] Waited 40.6 ms on lock 0x7b44000232cc. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f4619097a95 00007f46190984b2 00007f461bd40511 00007f461bd3be1a 00007f461bd2fbee 00007f461bd2ef36 00007f461bd2eb58 00007f461bd38551 00007f461bd38509 00007f461bd38499
0807 13:40:49.074764 (+ 15914us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b18002aa8a0. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f46220248b1 00007f4622031661 00007f46190fc4ca 00007f46227ddf99 00007f4618fc0990 00007f4619182864 00007f4619182155 00007f461c0a53d0 00007f461c0b7576 00007f461c0c80d7 00007f461c0c8058
0807 13:40:49.074941 (+ 177us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:49.075012 (+ 71us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:49.143588 (+ 68576us) raft_consensus.cc:1671] finished
0807 13:40:49.143618 (+ 30us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:49.143758 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":46197,"prepare.queue_time_us":37065,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":10102,"raft.queue_time_us":552965,"raft.run_cpu_time_us":400,"raft.run_wall_time_us":83076,"spinlock_wait_cycles":97753088,"thread_start_us":193712,"threads_started":1,"wal-append.queue_time_us":273416}
I20260807 13:40:49.194876 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "830e8cb8ce434e6391c09530c677a61d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:49.283138 23599 raft_consensus.cc:2454] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
W20260807 13:40:49.195364 23711 rpcz_store.cc:269] 0807 13:40:47.572526 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.095181 (+1522655us) service_pool.cc:227] Handling call
0807 13:40:49.107197 (+ 12016us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:49.150306 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "830e8cb8ce434e6391c09530c677a61d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:49.162439 24666 leader_election.cc:288] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:49.197394 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 81182us
I20260807 13:40:49.077299 24637 raft_consensus.cc:504] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.143774 24667 raft_consensus.cc:2726] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:49.203898 23772 leader_election.cc:302] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:49.114200 24583 leader_election.cc:288] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:49.183176 23818 raft_consensus.cc:2379] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 1: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:49.230072 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:49.242057 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:49.164243 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f8a5f186bf1473a988921e5efa3e574" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:49.304265 23820 raft_consensus.cc:2454] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:40:49.202625 23813 raft_consensus.cc:2379] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 2: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:49.277184 24557 raft_consensus.cc:3037] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:49.183176 24623 leader_election.cc:288] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:49.196482 24748 leader_election.cc:288] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:49.113499 24739 raft_consensus.cc:482] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:49.311580 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:49.312052 24739 raft_consensus.cc:3037] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:49.312583 23699 raft_consensus.cc:2379] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:49.284859 23594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 504) took 1079 ms. Trace:
I20260807 13:40:49.159391 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:49.256827 23707 raft_consensus.cc:2454] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:49.197726 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:49.229586 24632 leader_election.cc:288] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:49.283807 23599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 503) took 1086 ms. Trace:
I20260807 13:40:49.322010 23599 rpcz_store.cc:276] 0807 13:40:48.197311 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.116017 (+918706us) service_pool.cc:227] Handling call
0807 13:40:49.283735 (+167718us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:49.283560 23662 leader_election.cc:302] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:49.157310 24651 raft_consensus.cc:504] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.326690 24651 leader_election.cc:288] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:49.283524 23597 raft_consensus.cc:2362] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1. Re-sending same reply.
I20260807 13:40:49.327819 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:49.329124 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:49.329659 23597 raft_consensus.cc:3037] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:49.228888 24703 raft_consensus.cc:2781] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:49.330955 24748 raft_consensus.cc:2726] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:49.331071 24703 raft_consensus.cc:482] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:49.331499 24703 raft_consensus.cc:3037] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:49.287427 23817 raft_consensus.cc:2379] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 1: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:49.233855 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 258) took 1029 ms. Trace:
I20260807 13:40:49.203917 24544 consensus_queue.cc:1035] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
W20260807 13:40:49.296423 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 92592.1us
I20260807 13:40:49.296423 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:49.335179 23600 raft_consensus.cc:3037] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:49.298630 23703 raft_consensus.cc:2454] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:49.183645 24605 raft_consensus.cc:504] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.305568 23660 leader_election.cc:302] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:49.301456 23554 leader_election.cc:302] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:49.196990 24742 raft_consensus.cc:482] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:49.274545 24643 raft_consensus.cc:482] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:49.291554 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:49.307323 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:49.238898 24610 raft_consensus.cc:686] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:49.203699 24709 raft_consensus.cc:3037] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:49.276659 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:49.292369 24758 raft_consensus.cc:2726] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:49.293462 24771 raft_consensus.cc:2781] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:49.294011 24519 raft_consensus.cc:2781] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260807 13:40:49.293093 24721 consensus_meta.cc:287] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.643s user 0.009s sys 0.006s
I20260807 13:40:49.291556 24662 leader_election.cc:288] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:49.237687 24547 raft_consensus.cc:482] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:49.319037 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:49.306526 24745 raft_consensus.cc:2781] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:49.324234 23662 leader_election.cc:302] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:49.295781 24733 raft_consensus.cc:2726] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:49.337378 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:49.340193 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:49.361502 23707 raft_consensus.cc:2379] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 3: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:49.361642 23662 leader_election.cc:302] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:49.361737 23703 raft_consensus.cc:2454] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:49.362303 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f8a5f186bf1473a988921e5efa3e574" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:49.362689 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9552d42b445450691daef21fba4059a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:49.363133 23662 leader_election.cc:302] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:49.363389 24733 raft_consensus.cc:2781] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:49.340500 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f8a5f186bf1473a988921e5efa3e574" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:49.342336 23535 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:40:49.364076 23599 raft_consensus.cc:2454] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 0.
I20260807 13:40:49.364290 23662 leader_election.cc:302] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:49.364568 24781 raft_consensus.cc:2726] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:49.364948 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:49.365322 23662 leader_election.cc:302] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:49.342501 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:49.313110 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 262) took 1108 ms. Trace:
I20260807 13:40:49.304630 24666 consensus_queue.cc:1035] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260807 13:40:49.346915 23711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 259) took 1143 ms. Trace:
I20260807 13:40:49.346920 23814 raft_consensus.cc:2379] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 3: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:49.343374 24742 raft_consensus.cc:3037] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:49.386041 23597 raft_consensus.cc:2454] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:49.363466 23703 raft_consensus.cc:2379] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 1: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:49.367062 23662 leader_election.cc:302] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:49.340301 23554 leader_election.cc:302] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:49.365506 23599 raft_consensus.cc:3037] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:49.365506 24623 raft_consensus.cc:2726] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:49.346546 24667 raft_consensus.cc:2741] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260807 13:40:49.366639 23661 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:47672 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 539)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 533)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 530)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 518)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 522)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 511)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 517)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 477)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 478)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 479)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 481)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 482)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 209)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 210)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 222)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 483)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 484)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 231)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 232)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 487)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 237)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 257)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 492)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 493)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 496)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 501)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 502)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 503)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 507)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 524)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 525)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 527)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 528)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 529)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 531)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 534)
I20260807 13:40:49.369656 23711 rpcz_store.cc:276] 0807 13:40:48.203327 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.292546 (+1089219us) service_pool.cc:227] Handling call
0807 13:40:49.346847 (+ 54301us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:49.370488 23702 raft_consensus.cc:2379] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:49.352950 24519 raft_consensus.cc:482] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
W20260807 13:40:49.371145 24811 log.cc:924] Time spent T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.074s user 0.000s sys 0.001s
I20260807 13:40:49.407817 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:49.408720 23820 raft_consensus.cc:2454] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:49.360255 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:49.372484 24773 leader_election.cc:288] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:49.348284 24643 raft_consensus.cc:504] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.376351 23598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 427) took 1065 ms. Trace:
I20260807 13:40:49.376077 24557 raft_consensus.cc:504] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.349622 24651 consensus_queue.cc:1035] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260807 13:40:49.384394 23600 raft_consensus.cc:2454] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:49.368719 24733 raft_consensus.cc:482] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:49.346959 24748 raft_consensus.cc:2781] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:49.365180 24781 raft_consensus.cc:2781] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:49.387041 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:49.352973 24714 leader_election.cc:288] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:49.369989 23699 rpcz_store.cc:276] 0807 13:40:48.204429 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.285752 (+1081323us) service_pool.cc:227] Handling call
0807 13:40:49.313051 (+ 27299us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:40:49.392016 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 51776.2us
I20260807 13:40:49.413168 23598 rpcz_store.cc:276] 0807 13:40:48.310991 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.156093 (+845102us) service_pool.cc:227] Handling call
0807 13:40:49.160158 (+ 4065us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:49.161302 (+ 1144us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:49.161329 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:49.161919 (+ 590us) log.cc:842] Serialized 26 byte log entry
0807 13:40:49.294507 (+132588us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:49.294544 (+ 37us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:49.294604 (+ 60us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:49.376161 (+ 81557us) raft_consensus.cc:1671] finished
0807 13:40:49.376179 (+ 18us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:49.376294 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":184,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":243,"thread_start_us":111328,"threads_started":1,"wal-append.queue_time_us":204159}
I20260807 13:40:49.351491 24771 raft_consensus.cc:482] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:49.390606 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:49.419055 23711 raft_consensus.cc:2454] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:49.394522 23555 leader_election.cc:302] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:49.419756 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:49.359253 23710 raft_consensus.cc:2454] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:49.366041 24745 raft_consensus.cc:482] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:49.411228 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4062e0223a4cc0b2e448e35445671d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:49.404309 23661 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:47672 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 530)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 518)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 272)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 273)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 274)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 522)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 511)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 517)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 477)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 478)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 479)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 481)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 482)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 209)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 210)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 222)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 483)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 484)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 231)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 232)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 487)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 237)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 257)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 492)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 493)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 496)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 501)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 502)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 503)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 507)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 524)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 525)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 527)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 528)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 529)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 531)
I20260807 13:40:49.427332 23703 raft_consensus.cc:3037] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:49.368841 24758 raft_consensus.cc:2726] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:49.373814 24702 leader_election.cc:288] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:49.332633 23700 rpcz_store.cc:276] 0807 13:40:48.202874 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:48.537059 (+334185us) service_pool.cc:227] Handling call
0807 13:40:49.196593 (+659534us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b54003809d4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:40:49.231907 (+ 35314us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":988484864}
I20260807 13:40:49.353489 23705 raft_consensus.cc:2379] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:49.346496 24653 consensus_queue.cc:1046] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
W20260807 13:40:49.408330 24814 log.cc:924] Time spent T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.291s user 0.001s sys 0.000s
I20260807 13:40:49.421320 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "830e8cb8ce434e6391c09530c677a61d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:49.402621 23595 raft_consensus.cc:2454] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:49.436218 23598 raft_consensus.cc:2379] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 1: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:49.368312 24547 raft_consensus.cc:504] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.314973 23594 rpcz_store.cc:276] 0807 13:40:48.197721 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.140329 (+942608us) service_pool.cc:227] Handling call
0807 13:40:49.163080 (+ 22751us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:49.199452 (+ 36372us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:49.209893 (+ 10441us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:49.231485 (+ 21592us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:49.236128 (+ 4643us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:49.240962 (+ 4834us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:49.276934 (+ 35972us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:49.422060 23555 leader_election.cc:302] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:49.416103 23815 raft_consensus.cc:3037] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:49.427938 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:49.415782 24781 raft_consensus.cc:482] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:49.409173 24519 raft_consensus.cc:3037] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:49.360440 24721 raft_consensus.cc:504] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.428536 23661 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:47672 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 518)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 272)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 273)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 274)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 276)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 522)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 277)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 275)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 511)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 517)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 477)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 478)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 479)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 481)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 482)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 209)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 210)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 222)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 483)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 484)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 231)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 232)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 487)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 237)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 257)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 492)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 493)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 496)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 501)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 502)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 503)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 507)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 524)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 525)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 527)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 528)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 529)
I20260807 13:40:49.416921 23813 raft_consensus.cc:2379] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 2: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:49.409477 24623 raft_consensus.cc:2726] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:49.437053 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:49.437911 23705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 260) took 1234 ms. Trace:
I20260807 13:40:49.451136 23705 rpcz_store.cc:276] 0807 13:40:48.203628 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.109741 (+906113us) service_pool.cc:227] Handling call
0807 13:40:49.437836 (+328095us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:49.452327 23772 leader_election.cc:302] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:49.453248 23772 leader_election.cc:302] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:49.425899 23599 raft_consensus.cc:2454] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:49.429795 24745 raft_consensus.cc:3037] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:49.414346 24667 raft_consensus.cc:2781] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:49.438895 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:49.458346 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 91334.1us
I20260807 13:40:49.458688 23598 raft_consensus.cc:2454] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:49.415679 24748 raft_consensus.cc:482] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:49.459115 23662 leader_election.cc:302] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:49.440243 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:49.459911 23600 raft_consensus.cc:2454] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:49.390821 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:49.417125 24733 raft_consensus.cc:3037] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:49.419582 24771 raft_consensus.cc:3037] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:49.442991 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:49.439378 24760 raft_consensus.cc:2741] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260807 13:40:49.462067 24623 raft_consensus.cc:2726] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:49.438213 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:49.453418 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:49.465477 23710 raft_consensus.cc:2454] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:49.465678 23813 raft_consensus.cc:3037] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:49.466398 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:49.447620 24653 raft_consensus.cc:3032] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:49.430591 24714 raft_consensus.cc:2726] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:49.437487 24719 leader_election.cc:288] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:49.388814 24644 consensus_queue.cc:1046] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260807 13:40:49.453969 24781 raft_consensus.cc:3037] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:49.456754 23555 leader_election.cc:302] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:49.459262 23772 leader_election.cc:302] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:49.445171 23661 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:47672 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 278)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 279)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 280)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 272)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 273)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 274)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 276)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 522)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 277)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 275)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 511)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 517)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 477)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 478)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 479)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 481)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 482)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 209)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 210)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 222)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 483)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 484)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 231)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 232)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 487)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 237)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 257)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 492)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 493)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 496)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 501)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 502)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 503)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 507)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 524)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 525)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 527)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 528)
I20260807 13:40:49.484807 23555 leader_election.cc:302] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:49.460091 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:49.486222 23555 leader_election.cc:302] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:49.464064 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:49.429193 24759 consensus_queue.cc:1046] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260807 13:40:49.470026 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:49.460726 24667 raft_consensus.cc:482] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:49.441099 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:49.469916 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:49.498502 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:49.490135 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:49.486792 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 88478.3us
I20260807 13:40:49.460352 23662 leader_election.cc:302] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:49.498471 24714 raft_consensus.cc:2781] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:49.508138 24714 raft_consensus.cc:482] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:49.508541 24714 raft_consensus.cc:3037] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:49.508437 23660 leader_election.cc:302] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:49.509199 24801 raft_consensus.cc:3032] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:49.509595 24801 raft_consensus.cc:729] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:49.469192 24649 leader_election.cc:288] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:49.510567 24801 consensus_queue.cc:260] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.466996 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
W20260807 13:40:49.512633 24817 log.cc:924] Time spent T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.056s user 0.000s sys 0.000s
I20260807 13:40:49.513337 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:49.488484 23600 raft_consensus.cc:2454] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:49.485622 23661 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:47672 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 282)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 283)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 272)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 273)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 274)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 276)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 522)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 277)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 275)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 511)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 517)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 477)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 478)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 479)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 481)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 482)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 209)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 210)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 222)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 483)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 484)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 231)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 232)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 487)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 237)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 257)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 492)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 493)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 496)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 501)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 502)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 503)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 507)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 524)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 525)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 527)
I20260807 13:40:49.439195 23709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 256) took 1237 ms. Trace:
I20260807 13:40:49.442595 24637 leader_election.cc:288] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:49.467618 24502 raft_consensus.cc:2781] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:49.433113 24610 consensus_queue.cc:237] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.450145 24795 raft_consensus.cc:504] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.524693 24502 raft_consensus.cc:686] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:49.525672 24502 consensus_queue.cc:237] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.480798 23710 raft_consensus.cc:2454] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:49.429800 24586 raft_consensus.cc:504] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.530390 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:49.532044 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:49.532224 23818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45360 (request call id 419) took 1025 ms. Trace:
I20260807 13:40:49.532522 24721 leader_election.cc:288] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:49.532630 23818 rpcz_store.cc:276] 0807 13:40:48.507062 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:48.509554 (+ 2492us) service_pool.cc:227] Handling call
0807 13:40:49.532038 (+1022484us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b54002e2cd4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:40:49.532163 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":948649216}
I20260807 13:40:49.533424 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:49.533757 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:49.522002 23661 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:47672 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 285)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 282)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 286)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 283)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 272)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 273)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 274)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 276)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 522)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 277)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 275)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 511)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 517)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 477)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 478)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 479)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 481)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 482)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 209)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 210)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 222)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 483)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 484)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 231)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 232)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 487)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 237)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 257)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 492)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 493)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 496)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 501)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 502)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 503)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 507)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 524)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 525)
I20260807 13:40:49.469542 24653 raft_consensus.cc:729] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:49.514182 24605 leader_election.cc:288] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:49.535621 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:49.536208 23820 raft_consensus.cc:3037] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:49.535948 24653 consensus_queue.cc:260] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.536727 24547 leader_election.cc:288] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:49.537022 24653 raft_consensus.cc:3037] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:49.479856 24643 leader_election.cc:288] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:49.463683 24666 raft_consensus.cc:2781] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:49.542896 24666 raft_consensus.cc:482] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:49.543320 24666 raft_consensus.cc:3037] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:49.544711 24519 raft_consensus.cc:504] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.545745 24709 raft_consensus.cc:504] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.505816 24719 raft_consensus.cc:2781] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:49.535655 24605 raft_consensus.cc:2781] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:49.547243 24719 raft_consensus.cc:482] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:49.547405 24605 raft_consensus.cc:482] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:49.547705 24719 raft_consensus.cc:3037] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:49.547857 24605 raft_consensus.cc:3037] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:49.462209 24799 raft_consensus.cc:2781] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:49.499733 24583 raft_consensus.cc:2781] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:40:49.552812 24799 raft_consensus.cc:482] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:49.552834 24583 raft_consensus.cc:482] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:49.553303 24799 raft_consensus.cc:3037] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:49.553350 24583 raft_consensus.cc:3037] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:49.479552 24644 raft_consensus.cc:3032] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Stepping down as leader of term 1
W20260807 13:40:49.528049 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 67761.3us
I20260807 13:40:49.507839 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:49.538889 23598 raft_consensus.cc:2379] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 3: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:49.540061 23661 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:47672 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 282)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 286)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 287)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 283)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 272)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 273)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 274)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 276)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 522)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 277)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 275)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 511)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 517)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 477)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 478)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 479)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 481)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 482)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 209)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 210)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 222)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 483)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 484)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 231)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 232)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 487)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 237)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 257)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 492)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 493)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 496)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 501)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 502)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 503)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 507)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 524)
I20260807 13:40:49.556077 23662 leader_election.cc:302] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:49.555891 23703 raft_consensus.cc:2454] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:50.234627 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:50.235306 23703 raft_consensus.cc:3037] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:49.522682 23709 rpcz_store.cc:276] 0807 13:40:48.201888 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.097789 (+895901us) service_pool.cc:227] Handling call
0807 13:40:49.427706 (+329917us) spinlock_profiling.cc:243] Waited 47.5 ms on lock 0x7b5400022954. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:40:49.436441 (+ 8735us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":109239552}
I20260807 13:40:49.534627 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:50.241308 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:50.242058 23710 raft_consensus.cc:3037] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:50.242251 23709 raft_consensus.cc:2379] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:50.243325 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:50.244192 23709 raft_consensus.cc:2379] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:50.245033 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:50.245870 23709 raft_consensus.cc:2379] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 2: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:49.581357 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9552d42b445450691daef21fba4059a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:50.247273 23594 raft_consensus.cc:2379] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 1: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:50.247818 23594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 518) took 1070 ms. Trace:
W20260807 13:40:50.248289 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 692233us
I20260807 13:40:50.248250 23594 rpcz_store.cc:276] 0807 13:40:49.177733 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.460846 (+283113us) service_pool.cc:227] Handling call
0807 13:40:49.577170 (+116324us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b5800001898. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914dbce 000000000034aea9 00007f4620f79a30 00007f462103f7b4 00007f462103f821 00007f4620fef1b0 00007f4620feea94 00007f461a6d6c04 00007f461a6d6b92
0807 13:40:50.247742 (+670572us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":23704320}
I20260807 13:40:50.249171 23662 leader_election.cc:302] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:50.250237 23594 raft_consensus.cc:1226] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:49.717175 23601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 433) took 1404 ms. Trace:
I20260807 13:40:50.251219 23594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 449) took 1599 ms. Trace:
I20260807 13:40:49.725891 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:50.251623 23594 rpcz_store.cc:276] 0807 13:40:48.652316 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.249520 (+1597204us) service_pool.cc:227] Handling call
0807 13:40:50.249983 (+ 463us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.250922 (+ 939us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.251164 (+ 242us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:49.729954 23590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 422) took 1421 ms. Trace:
I20260807 13:40:50.252727 23590 rpcz_store.cc:276] 0807 13:40:48.308295 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.153700 (+845405us) service_pool.cc:227] Handling call
0807 13:40:49.154169 (+ 469us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:49.154728 (+ 559us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:49.154764 (+ 36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:49.155385 (+ 621us) log.cc:842] Serialized 26 byte log entry
0807 13:40:49.350696 (+195311us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:40:49.352944 (+ 2248us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:49.367615 (+ 14671us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:49.729655 (+362040us) raft_consensus.cc:1671] finished
0807 13:40:49.729676 (+ 21us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:49.729891 (+ 215us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":4650,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":195,"thread_start_us":109119,"threads_started":1,"wal-append.queue_time_us":201310}
I20260807 13:40:49.732753 23588 raft_consensus.cc:2379] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 3: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:50.255581 23588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 500) took 2059 ms. Trace:
I20260807 13:40:50.255910 23588 rpcz_store.cc:276] 0807 13:40:48.196239 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.146722 (+950483us) service_pool.cc:227] Handling call
0807 13:40:50.255391 (+1108669us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b540024c054. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:40:50.255526 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1336141696}
I20260807 13:40:49.522755 23812 raft_consensus.cc:2454] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:49.613543 23813 raft_consensus.cc:2454] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:50.251122 23601 rpcz_store.cc:276] 0807 13:40:48.312633 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.162599 (+849966us) service_pool.cc:227] Handling call
0807 13:40:49.163129 (+ 530us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:49.163453 (+ 324us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:49.163487 (+ 34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:49.196986 (+ 33499us) log.cc:842] Serialized 26 byte log entry
0807 13:40:49.340141 (+143155us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:49.340166 (+ 25us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:49.340213 (+ 47us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:49.716869 (+376656us) raft_consensus.cc:1671] finished
0807 13:40:49.716900 (+ 31us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:49.717101 (+ 201us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":3650,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":164,"thread_start_us":101584,"threads_started":1,"wal-append.queue_time_us":211462}
I20260807 13:40:49.534627 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:50.260222 23601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 516) took 1083 ms. Trace:
I20260807 13:40:50.260452 23817 raft_consensus.cc:2379] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:50.260504 23601 rpcz_store.cc:276] 0807 13:40:49.177176 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.259576 (+1082400us) service_pool.cc:227] Handling call
0807 13:40:50.259832 (+ 256us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.259953 (+ 121us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:50.259968 (+ 15us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:50.260021 (+ 53us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:50.260055 (+ 34us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.260106 (+ 51us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:50.260177 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.261590 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:50.262282 23817 raft_consensus.cc:2454] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:49.588927 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:50.263724 23821 raft_consensus.cc:2454] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:50.264276 23821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45360 (request call id 430) took 1753 ms. Trace:
I20260807 13:40:50.264616 23821 rpcz_store.cc:276] 0807 13:40:48.510758 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.344697 (+833939us) service_pool.cc:227] Handling call
0807 13:40:49.586884 (+242187us) spinlock_profiling.cc:243] Waited 7.47 ms on lock 0x7b5800255098. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f4620fef1b0 00007f4620feea94 00007f461a6d6c04 00007f461a6d6b92
0807 13:40:50.264193 (+677309us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":17180928}
I20260807 13:40:50.265839 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:49.573982 23823 raft_consensus.cc:2454] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:49.539026 23825 raft_consensus.cc:2454] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
W20260807 13:40:50.268268 23825 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45360 (request call id 455) took 1437 ms (client timeout 1764 ms). Trace:
W20260807 13:40:50.268728 23825 rpcz_store.cc:269] 0807 13:40:48.830744 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.102105 (+271361us) service_pool.cc:227] Handling call
0807 13:40:50.268202 (+1166097us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.268999 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:50.269778 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:49.480334 24557 leader_election.cc:288] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:50.276785 24557 raft_consensus.cc:482] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:50.277298 24557 raft_consensus.cc:504] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.567773 24586 leader_election.cc:288] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:49.534835 24623 raft_consensus.cc:2781] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:50.280827 24623 raft_consensus.cc:482] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:50.281239 24623 raft_consensus.cc:3037] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:49.555630 24644 raft_consensus.cc:729] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:50.285713 24644 consensus_queue.cc:260] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.629807 24703 raft_consensus.cc:504] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.292665 24557 leader_election.cc:288] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:50.293329 24703 leader_election.cc:288] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:49.592404 24709 leader_election.cc:288] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:49.636030 24583 raft_consensus.cc:504] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.296797 24623 raft_consensus.cc:504] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.273650 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:50.299100 24583 leader_election.cc:288] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:49.626575 24605 raft_consensus.cc:504] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.301841 24605 leader_election.cc:288] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:49.637149 24666 raft_consensus.cc:504] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.304865 24666 leader_election.cc:288] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:49.521189 24667 raft_consensus.cc:3037] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:49.599062 24714 raft_consensus.cc:504] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.308897 24714 leader_election.cc:288] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:49.645208 23814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45360 (request call id 428) took 1135 ms. Trace:
I20260807 13:40:49.607486 24727 raft_consensus.cc:504] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.310534 23814 rpcz_store.cc:276] 0807 13:40:48.510157 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.122032 (+611875us) service_pool.cc:227] Handling call
0807 13:40:49.644889 (+522857us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54002832d4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:40:49.645106 (+ 217us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":429569920}
I20260807 13:40:50.311877 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:50.312505 24727 leader_election.cc:288] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:49.584523 24733 raft_consensus.cc:504] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.605937 24739 raft_consensus.cc:504] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.315927 23590 raft_consensus.cc:1226] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:50.316695 24739 leader_election.cc:288] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:49.606330 24745 raft_consensus.cc:504] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.319339 23590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 455) took 1482 ms. Trace:
I20260807 13:40:50.320631 24745 leader_election.cc:288] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:50.320098 23590 rpcz_store.cc:276] 0807 13:40:48.837250 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.254242 (+1416992us) service_pool.cc:227] Handling call
0807 13:40:50.254572 (+ 330us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.316421 (+ 61849us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.319068 (+ 2647us) spinlock_profiling.cc:243] Waited 61.1 ms on lock 0x7b54002f44d4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:40:50.319277 (+ 209us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":140513536}
I20260807 13:40:49.604851 24781 raft_consensus.cc:504] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.526384 24795 leader_election.cc:288] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:49.633307 24799 raft_consensus.cc:504] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.331682 24781 leader_election.cc:288] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:50.299045 23709 raft_consensus.cc:2454] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:50.332202 24799 leader_election.cc:288] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:50.332757 24623 leader_election.cc:288] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:50.333256 23590 raft_consensus.cc:1226] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 13:40:50.333180 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:50.333920 23709 raft_consensus.cc:3037] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:50.334069 23590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 520) took 1155 ms. Trace:
I20260807 13:40:50.334563 23590 rpcz_store.cc:276] 0807 13:40:49.178306 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.321492 (+1143186us) service_pool.cc:227] Handling call
0807 13:40:50.332989 (+ 11497us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:50.333781 (+ 792us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.334010 (+ 229us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:49.596055 24800 raft_consensus.cc:504] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.565634 24801 raft_consensus.cc:3037] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:50.339414 24800 leader_election.cc:288] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:50.339237 24667 raft_consensus.cc:504] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.340257 23825 raft_consensus.cc:2379] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 2: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:50.341416 24667 leader_election.cc:288] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:49.619764 24519 leader_election.cc:288] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:49.629807 24719 raft_consensus.cc:504] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.344476 23594 raft_consensus.cc:1226] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260807 13:40:50.345561 24719 leader_election.cc:288] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:49.617605 24742 raft_consensus.cc:504] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:49.645555 23769 leader_election.cc:302] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:50.015744 23597 raft_consensus.cc:3037] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:40:50.352317 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 706751us
I20260807 13:40:50.352777 24742 leader_election.cc:288] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:50.352988 23769 leader_election.cc:302] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:50.353875 23591 raft_consensus.cc:2379] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 3: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:50.354091 23769 leader_election.cc:302] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:50.042016 23599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 443) took 1626 ms. Trace:
I20260807 13:40:50.354919 24799 raft_consensus.cc:2781] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:50.355327 24799 raft_consensus.cc:482] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:50.355252 23591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 506) took 2156 ms. Trace:
I20260807 13:40:50.355883 24799 raft_consensus.cc:3037] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:50.355942 23591 rpcz_store.cc:276] 0807 13:40:48.198345 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.135525 (+937180us) service_pool.cc:227] Handling call
0807 13:40:50.354994 (+1219469us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000e4554. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:40:50.355174 (+ 180us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2456874368}
I20260807 13:40:50.345980 23594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 450) took 1571 ms. Trace:
I20260807 13:40:50.358884 24745 raft_consensus.cc:2781] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:50.359555 24745 raft_consensus.cc:482] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:50.067551 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 265) took 1862 ms. Trace:
I20260807 13:40:50.088572 23449 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37968 (request call id 125) took 3273 ms. Trace:
I20260807 13:40:50.360153 24745 raft_consensus.cc:3037] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:40:50.096818 23704 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 271) took 1786 ms (client timeout 1980 ms). Trace:
I20260807 13:40:50.360890 23769 leader_election.cc:302] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
W20260807 13:40:50.361052 23704 rpcz_store.cc:269] 0807 13:40:48.310443 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.098134 (+787691us) service_pool.cc:227] Handling call
0807 13:40:50.096546 (+998412us) spinlock_profiling.cc:243] Waited 972 ms on lock 0x7b540035acd4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:40:50.096746 (+ 200us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2235365120}
I20260807 13:40:50.361662 24583 raft_consensus.cc:2781] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:50.362015 24583 raft_consensus.cc:482] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:50.362327 24583 raft_consensus.cc:3037] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:50.049885 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:50.360179 23702 rpcz_store.cc:276] 0807 13:40:48.205358 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.114113 (+908755us) service_pool.cc:227] Handling call
0807 13:40:50.067209 (+953096us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b54001aca54. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:40:50.067418 (+ 209us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":65307008}
I20260807 13:40:50.363186 23711 raft_consensus.cc:3037] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:50.363909 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:50.364535 23702 raft_consensus.cc:2454] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:50.365365 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:50.366104 23702 raft_consensus.cc:2379] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 3: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:50.184440 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:50.366677 23699 raft_consensus.cc:3037] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:50.360271 23449 rpcz_store.cc:276] 0807 13:40:46.815695 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:46.815963 (+ 268us) service_pool.cc:227] Handling call
0807 13:40:50.088485 (+3272522us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:40:48.294302 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:40:48.435229 (+140927us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:40:48.444715 (+ 9486us) write_op.cc:435] Acquired schema lock
0807 13:40:48.448295 (+ 3580us) tablet.cc:660] Decoding operations
0807 13:40:48.527047 (+ 78752us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:40:48.535171 (+ 8124us) write_op.cc:641] Partition lock acquired for write op
0807 13:40:48.536982 (+ 1811us) tablet.cc:683] Acquiring locks for 2 operations
0807 13:40:48.610709 (+ 73727us) tablet.cc:699] Row locks acquired
0807 13:40:48.619072 (+ 8363us) write_op.cc:260] PREPARE: finished
0807 13:40:48.683299 (+ 64227us) write_op.cc:270] Start()
0807 13:40:48.739944 (+ 56645us) write_op.cc:276] Timestamp: P: 1786110048670529 usec, L: 0
0807 13:40:48.739990 (+ 46us) op_driver.cc:331] REPLICATION: starting
0807 13:40:48.815866 (+ 75876us) log.cc:842] Serialized 918 byte log entry
0807 13:40:48.996738 (+180872us) op_driver.cc:444] REPLICATION: finished
0807 13:40:49.093448 (+ 96710us) write_op.cc:301] APPLY: starting
0807 13:40:49.093531 (+ 83us) tablet.cc:1365] starting BulkCheckPresence
0807 13:40:49.112504 (+ 18973us) tablet.cc:1368] finished BulkCheckPresence
0807 13:40:49.232135 (+119631us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:40:49.287442 (+ 55307us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:40:49.287637 (+ 195us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0807 13:40:49.287692 (+ 55us) write_op.cc:312] APPLY: finished
0807 13:40:49.287921 (+ 229us) log.cc:842] Serialized 28 byte log entry
0807 13:40:49.288097 (+ 176us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:40:49.288193 (+ 96us) write_op.cc:454] Released schema lock
0807 13:40:49.288247 (+ 54us) write_op.cc:341] FINISH: Updating metrics
0807 13:40:49.288497 (+ 250us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:40:49.288524 (+ 27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":473,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":65402,"apply.run_cpu_time_us":3182,"apply.run_wall_time_us":195352,"num_ops":2,"prepare.queue_time_us":137373,"prepare.run_cpu_time_us":10156,"prepare.run_wall_time_us":636450,"replication_time_us":245975,"thread_start_us":110479,"threads_started":2}]]}
I20260807 13:40:50.370115 23818 raft_consensus.cc:2454] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:50.354794 23599 rpcz_store.cc:276] 0807 13:40:48.415502 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.511387 (+1095885us) service_pool.cc:227] Handling call
0807 13:40:49.518795 (+ 7408us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:49.520008 (+ 1213us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:49.520027 (+ 19us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:49.538396 (+ 18369us) log.cc:842] Serialized 26 byte log entry
0807 13:40:50.041127 (+502731us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:50.041184 (+ 57us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.041293 (+ 109us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:50.041766 (+ 473us) raft_consensus.cc:1671] finished
0807 13:40:50.041788 (+ 22us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:50.041948 (+ 160us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2280,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":2164,"thread_start_us":14407,"threads_started":1,"wal-append.queue_time_us":13167}
I20260807 13:40:50.371539 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:50.372418 23599 raft_consensus.cc:1226] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 13:40:50.372643 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:50.362258 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4062e0223a4cc0b2e448e35445671d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:50.373677 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:50.373929 23704 raft_consensus.cc:2379] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 1: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:50.189909 24610 raft_consensus.cc:482] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:50.373000 23599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 523) took 1194 ms. Trace:
I20260807 13:40:50.374905 24610 raft_consensus.cc:504] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.375308 23599 rpcz_store.cc:276] 0807 13:40:49.179005 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.371885 (+1192880us) service_pool.cc:227] Handling call
0807 13:40:50.372203 (+ 318us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:50.372747 (+ 544us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.372950 (+ 203us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.376924 24610 leader_election.cc:288] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:50.198585 23447 catalog_manager.cc:5495] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 1 to 2, leader changed from d28e736aee9f4f01b013de670a762697 (127.21.82.67) to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 2 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:50.378002 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:50.228475 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:50.378731 23700 raft_consensus.cc:2454] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:50.378190 23447 catalog_manager.cc:5495] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 0 to 1, leader changed from <none> to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 1 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:50.379627 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:50.380246 23700 raft_consensus.cc:2454] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:50.379809 23447 catalog_manager.cc:5495] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 1 to 2, leader changed from d28e736aee9f4f01b013de670a762697 (127.21.82.67) to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 2 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:49.487972 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:50.257452 23710 raft_consensus.cc:2454] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:50.385752 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:50.258150 23812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45360 (request call id 425) took 1748 ms. Trace:
I20260807 13:40:50.258991 23813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45360 (request call id 462) took 1093 ms. Trace:
I20260807 13:40:50.386399 23595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 535) took 1151 ms. Trace:
I20260807 13:40:49.567448 23815 raft_consensus.cc:2454] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:49.623607 23820 raft_consensus.cc:2454] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:50.392969 23820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45360 (request call id 458) took 1464 ms. Trace:
I20260807 13:40:50.393272 23820 rpcz_store.cc:276] 0807 13:40:48.928563 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.414700 (+486137us) service_pool.cc:227] Handling call
0807 13:40:49.535480 (+120780us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b5800255098. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f4620fef1b0 00007f4620feea94 00007f461a6d6c04 00007f461a6d6b92
0807 13:40:50.392910 (+857430us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6451584}
I20260807 13:40:50.394237 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:50.366503 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 522) took 1137 ms. Trace:
I20260807 13:40:50.397229 23702 rpcz_store.cc:276] 0807 13:40:49.229216 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.365135 (+1135919us) service_pool.cc:227] Handling call
0807 13:40:50.366450 (+ 1315us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.262863 23601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 517) took 1085 ms. Trace:
I20260807 13:40:50.398304 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:50.267608 24834 raft_consensus.cc:2781] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:50.399159 23702 raft_consensus.cc:2454] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:50.399544 24834 raft_consensus.cc:482] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:50.271126 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:50.399976 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 515) took 1271 ms. Trace:
W20260807 13:40:50.268193 23823 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45360 (request call id 437) took 1755 ms (client timeout 1942 ms). Trace:
W20260807 13:40:50.400758 23823 rpcz_store.cc:269] 0807 13:40:48.512379 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.038494 (+526115us) service_pool.cc:227] Handling call
0807 13:40:49.108332 (+ 69838us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b5800255098. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f4620fef1b0 00007f4620feea94 00007f461a6d6c04 00007f461a6d6b92
0807 13:40:50.268036 (+1159704us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b54002d7154. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:40:50.268138 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":877137024}
I20260807 13:40:50.272519 23662 leader_election.cc:302] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
W20260807 13:40:50.402164 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 129739us
I20260807 13:40:50.402863 23662 leader_election.cc:302] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:50.403915 23662 leader_election.cc:302] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:50.405704 23662 leader_election.cc:302] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:50.270361 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac6e18ecd14ba2a7d3e846a9fc81bf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:50.275611 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:49.489287 24651 raft_consensus.cc:2781] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:50.291033 24644 raft_consensus.cc:3037] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:50.414088 24651 raft_consensus.cc:482] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:50.414705 24651 raft_consensus.cc:3037] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:50.415927 24583 raft_consensus.cc:504] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.312664 23814 raft_consensus.cc:2379] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 2: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:49.460614 24748 raft_consensus.cc:3037] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:50.419512 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:50.422022 24623 raft_consensus.cc:2781] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:50.317373 24733 leader_election.cc:288] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:50.318868 23703 raft_consensus.cc:2454] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:50.422569 24623 raft_consensus.cc:482] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:50.418409 24610 raft_consensus.cc:2741] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260807 13:40:50.423110 24623 raft_consensus.cc:3037] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:50.423378 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:49.603929 24771 raft_consensus.cc:504] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.426021 24771 leader_election.cc:288] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:50.342617 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:50.426779 24519 raft_consensus.cc:2781] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:50.427328 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:50.427733 23705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 273) took 1024 ms. Trace:
I20260807 13:40:50.358978 23594 rpcz_store.cc:276] 0807 13:40:48.774782 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.252723 (+1477941us) service_pool.cc:227] Handling call
0807 13:40:50.253097 (+ 374us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:50.344977 (+ 91880us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.345692 (+ 715us) spinlock_profiling.cc:243] Waited 91.1 ms on lock 0x7b54002549d4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:40:50.345922 (+ 230us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":209429760}
I20260807 13:40:50.428282 23705 rpcz_store.cc:276] 0807 13:40:49.403420 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.252286 (+848866us) service_pool.cc:227] Handling call
0807 13:40:50.275442 (+ 23156us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b5800004598. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f4620fef1b0 00007f4620feea94 00007f461a6d6c04 00007f461a6d6b92
0807 13:40:50.427650 (+152208us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":47685376}
I20260807 13:40:50.428651 24583 leader_election.cc:288] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:50.428571 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:50.429054 23594 raft_consensus.cc:1226] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
W20260807 13:40:50.346225 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 73015.2us
I20260807 13:40:49.489477 23555 leader_election.cc:302] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:50.429427 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:50.429734 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:50.430060 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 940575us
I20260807 13:40:50.430379 23825 raft_consensus.cc:2454] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:50.207607 23600 raft_consensus.cc:1226] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:50.431170 23600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 446) took 1925 ms. Trace:
I20260807 13:40:50.373214 23711 raft_consensus.cc:2454] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:50.381044 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:50.214584 23661 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:47672 dropped due to backpressure. The service queue is full; it has 50 items. [suppressed 7 similar messages]
I20260807 13:40:50.381680 23704 raft_consensus.cc:3037] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:50.377789 24799 raft_consensus.cc:504] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.233090 24832 raft_consensus.cc:2781] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:50.358923 23597 raft_consensus.cc:2454] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:50.382877 23447 catalog_manager.cc:5495] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 1 to 2, leader changed from d28e736aee9f4f01b013de670a762697 (127.21.82.67) to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 2 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:50.384006 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:50.386574 23812 rpcz_store.cc:276] 0807 13:40:48.509327 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.395546 (+886219us) service_pool.cc:227] Handling call
0807 13:40:50.258084 (+862538us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.386831 23595 rpcz_store.cc:276] 0807 13:40:49.235148 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.461432 (+226284us) service_pool.cc:227] Handling call
0807 13:40:50.386323 (+924891us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.386677 23813 rpcz_store.cc:276] 0807 13:40:49.165558 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.453119 (+287561us) service_pool.cc:227] Handling call
0807 13:40:50.258914 (+805795us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.386440 23710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 523) took 1109 ms. Trace:
I20260807 13:40:50.400403 23821 raft_consensus.cc:2379] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:50.398802 23601 rpcz_store.cc:276] 0807 13:40:49.177451 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.261820 (+1084369us) service_pool.cc:227] Handling call
0807 13:40:50.262123 (+ 303us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.262300 (+ 177us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:50.262328 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:50.262401 (+ 73us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:40:50.262432 (+ 31us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.262487 (+ 55us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:50.262816 (+ 329us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.409245 23662 leader_election.cc:302] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:50.400342 23702 rpcz_store.cc:276] 0807 13:40:49.128283 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.398027 (+1269744us) service_pool.cc:227] Handling call
0807 13:40:50.399914 (+ 1887us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:40:50.410194 23535 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:40:50.358471 23591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 522) took 1179 ms. Trace:
I20260807 13:40:50.411849 23554 leader_election.cc:302] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:50.399979 24834 raft_consensus.cc:3037] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:50.431223 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:50.411847 23709 raft_consensus.cc:2454] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:50.427634 24748 raft_consensus.cc:504] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.225448 23598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 512) took 1049 ms. Trace:
I20260807 13:40:50.447507 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:50.535650 23711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 511) took 1691 ms. Trace:
I20260807 13:40:50.535233 23598 rpcz_store.cc:276] 0807 13:40:49.176076 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.487689 (+311613us) service_pool.cc:227] Handling call
0807 13:40:50.225170 (+737481us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b54003c5d54. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:40:50.225368 (+ 198us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":72260480}
I20260807 13:40:50.535192 23447 catalog_manager.cc:5495] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 2 to 3, leader changed from d28e736aee9f4f01b013de670a762697 (127.21.82.67) to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 3 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:50.536079 23711 rpcz_store.cc:276] 0807 13:40:48.844076 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.447150 (+1603074us) service_pool.cc:227] Handling call
0807 13:40:50.535591 (+ 88441us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.431546 23600 rpcz_store.cc:276] 0807 13:40:48.505777 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.528169 (+1022392us) service_pool.cc:227] Handling call
0807 13:40:50.207320 (+679151us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.430900 (+223580us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.431108 (+ 208us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.537024 23661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 524) took 1222 ms. Trace:
I20260807 13:40:50.537484 23661 rpcz_store.cc:276] 0807 13:40:49.314531 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.536965 (+1222434us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260807 13:40:50.517684 24745 raft_consensus.cc:504] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.538167 23600 raft_consensus.cc:1226] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 13:40:50.411288 23699 raft_consensus.cc:2454] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:50.538931 23600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 527) took 1359 ms. Trace:
I20260807 13:40:50.539315 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 537) took 1174 ms. Trace:
I20260807 13:40:50.539264 23600 rpcz_store.cc:276] 0807 13:40:49.179819 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.537511 (+1357692us) service_pool.cc:227] Handling call
0807 13:40:50.537965 (+ 454us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:50.538678 (+ 713us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.538874 (+ 196us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.538341 23661 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:47672 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 517)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 477)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 478)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 479)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 481)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 482)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 209)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 210)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 222)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 483)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 484)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 231)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 232)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 487)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 237)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 257)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 492)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 493)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 496)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 501)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 502)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 503)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 507)
I20260807 13:40:50.539800 23699 rpcz_store.cc:276] 0807 13:40:49.364797 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.431407 (+ 66610us) service_pool.cc:227] Handling call
0807 13:40:50.184246 (+752839us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b5800004598. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f4620fef1b0 00007f4620feea94 00007f461a6d6c04 00007f461a6d6b92
0807 13:40:50.539189 (+354943us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4658560}
I20260807 13:40:50.412034 24781 raft_consensus.cc:2726] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:50.406327 24800 raft_consensus.cc:2726] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:50.490988 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:50.429735 23594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 525) took 1250 ms. Trace:
I20260807 13:40:50.446817 24742 raft_consensus.cc:2781] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:50.430514 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:50.541731 23601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 530) took 1312 ms. Trace:
I20260807 13:40:50.568838 23601 rpcz_store.cc:276] 0807 13:40:49.229270 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.540963 (+1311693us) service_pool.cc:227] Handling call
0807 13:40:50.541265 (+ 302us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.541427 (+ 162us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:50.541451 (+ 24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:50.541490 (+ 39us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:50.541519 (+ 29us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.541571 (+ 52us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:50.541679 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.542023 24833 raft_consensus.cc:2726] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:50.481384 23660 leader_election.cc:302] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:50.542420 24832 raft_consensus.cc:686] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
W20260807 13:40:50.542847 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 131078us
I20260807 13:40:50.543186 23821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 266) took 1019 ms. Trace:
I20260807 13:40:50.431761 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:50.543588 23710 rpcz_store.cc:276] 0807 13:40:49.276640 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.385534 (+1108894us) service_pool.cc:227] Handling call
0807 13:40:50.386395 (+ 861us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.544350 24771 raft_consensus.cc:2781] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election won for term 3
W20260807 13:40:50.544967 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 135766us
I20260807 13:40:50.545609 23597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 463) took 1258 ms. Trace:
I20260807 13:40:50.458458 23555 leader_election.cc:302] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:50.413125 23820 raft_consensus.cc:2454] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:50.546290 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:50.558459 23707 raft_consensus.cc:2379] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 1: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:50.548782 23825 raft_consensus.cc:2379] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:50.540539 23600 raft_consensus.cc:1226] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:50.547662 23598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 526) took 1368 ms. Trace:
I20260807 13:40:50.411077 23815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45360 (request call id 427) took 1897 ms. Trace:
I20260807 13:40:50.603842 23597 rpcz_store.cc:276] 0807 13:40:49.287310 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.507551 (+220241us) service_pool.cc:227] Handling call
0807 13:40:50.545552 (+1038001us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.604552 23662 leader_election.cc:302] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:50.605561 23597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 534) took 1370 ms. Trace:
I20260807 13:40:50.605917 23823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 270) took 1050 ms. Trace:
I20260807 13:40:50.606375 23823 rpcz_store.cc:276] 0807 13:40:49.560253 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.401608 (+841355us) service_pool.cc:227] Handling call
0807 13:40:50.605859 (+204251us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.607072 23820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 258) took 1086 ms. Trace:
I20260807 13:40:50.606573 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f8a5f186bf1473a988921e5efa3e574" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
W20260807 13:40:50.606001 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 147659us
I20260807 13:40:50.605983 23597 rpcz_store.cc:276] 0807 13:40:49.234877 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.604704 (+1369827us) service_pool.cc:227] Handling call
0807 13:40:50.605001 (+ 297us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.605269 (+ 268us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:50.605294 (+ 25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:50.605335 (+ 41us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:50.605361 (+ 26us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.605411 (+ 50us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:50.605508 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.567247 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:50.608155 23818 raft_consensus.cc:2454] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:50.608680 23555 leader_election.cc:302] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:50.427337 24519 raft_consensus.cc:482] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:50.614967 23601 raft_consensus.cc:1226] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:50.571182 23705 raft_consensus.cc:2379] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 3: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:50.615628 23601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 532) took 1381 ms. Trace:
I20260807 13:40:50.616134 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:50.609299 24719 raft_consensus.cc:2781] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:50.616825 24719 raft_consensus.cc:482] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:50.617206 24719 raft_consensus.cc:3037] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:50.617262 24745 leader_election.cc:288] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:50.617426 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:50.617990 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:50.618304 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:50.615928 23601 rpcz_store.cc:276] 0807 13:40:49.234292 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.569816 (+1335524us) service_pool.cc:227] Handling call
0807 13:40:50.614798 (+ 44982us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.615410 (+ 612us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.615578 (+ 168us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.619113 23825 raft_consensus.cc:2379] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:50.619442 23700 raft_consensus.cc:2379] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 3: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:50.619918 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 532) took 1256 ms. Trace:
I20260807 13:40:50.619962 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:50.620503 23707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 526) took 1264 ms. Trace:
I20260807 13:40:50.620996 23707 rpcz_store.cc:276] 0807 13:40:49.356044 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.362057 (+ 6013us) service_pool.cc:227] Handling call
0807 13:40:50.620323 (+1258266us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540035bbd4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:40:50.620444 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2748857216}
I20260807 13:40:50.611816 23820 rpcz_store.cc:276] 0807 13:40:49.520799 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.394008 (+873209us) service_pool.cc:227] Handling call
0807 13:40:50.607016 (+213008us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.621487 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:50.622021 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:50.622169 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:50.622551 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:50.620381 23700 rpcz_store.cc:276] 0807 13:40:49.363255 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.380809 (+1017554us) service_pool.cc:227] Handling call
0807 13:40:50.619863 (+239054us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.612998 24667 raft_consensus.cc:2781] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:50.613230 23813 raft_consensus.cc:2379] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:50.624544 24771 raft_consensus.cc:686] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:50.564694 23709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 288) took 1025 ms. Trace:
I20260807 13:40:50.624892 24667 raft_consensus.cc:482] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:50.625051 23709 rpcz_store.cc:276] 0807 13:40:49.539712 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.332876 (+793164us) service_pool.cc:227] Handling call
0807 13:40:50.558939 (+226063us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.613507 24733 raft_consensus.cc:2781] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:40:50.625532 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:50.625749 24733 raft_consensus.cc:482] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:50.626160 24733 raft_consensus.cc:3037] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:50.626772 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:50.626484 24832 consensus_queue.cc:237] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.627983 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac6e18ecd14ba2a7d3e846a9fc81bf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:50.534498 23591 rpcz_store.cc:276] 0807 13:40:49.178767 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.357347 (+1178580us) service_pool.cc:227] Handling call
0807 13:40:50.357775 (+ 428us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.358009 (+ 234us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:50.358060 (+ 51us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:50.358125 (+ 65us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:50.358173 (+ 48us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.358261 (+ 88us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:50.358410 (+ 149us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.603963 23815 rpcz_store.cc:276] 0807 13:40:48.509861 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:49.322228 (+812367us) service_pool.cc:227] Handling call
0807 13:40:50.407118 (+1084890us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.629227 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:50.630332 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:50.614025 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4062e0223a4cc0b2e448e35445671d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:50.630806 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:50.566586 23594 rpcz_store.cc:276] 0807 13:40:49.179394 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.428521 (+1249127us) service_pool.cc:227] Handling call
0807 13:40:50.428875 (+ 354us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.429481 (+ 606us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.429682 (+ 201us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.616295 24781 raft_consensus.cc:2781] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:50.619181 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:50.620715 23825 raft_consensus.cc:2379] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:50.553854 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:50.623881 24799 leader_election.cc:288] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:50.624122 23710 raft_consensus.cc:1226] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:50.624420 23820 raft_consensus.cc:2354] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 2. Current term is 3.
I20260807 13:40:50.571514 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:50.609872 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 128613us
I20260807 13:40:50.642017 23710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 477) took 5504 ms. Trace:
I20260807 13:40:50.642354 23710 rpcz_store.cc:276] 0807 13:40:45.137730 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.623614 (+5485884us) service_pool.cc:227] Handling call
0807 13:40:50.623949 (+ 335us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.641799 (+ 17850us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.641967 (+ 168us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.643297 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:50.644683 23710 raft_consensus.cc:2379] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 2: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:50.625329 24667 raft_consensus.cc:3037] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:50.610874 23711 raft_consensus.cc:2396] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 13:40:50.604094 23598 rpcz_store.cc:276] 0807 13:40:49.179621 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.536297 (+1356676us) service_pool.cc:227] Handling call
0807 13:40:50.547242 (+ 10945us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.547396 (+ 154us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:50.547419 (+ 23us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:50.547456 (+ 37us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:50.547482 (+ 26us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.547525 (+ 43us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:50.547612 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.631558 23823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 276) took 1009 ms. Trace:
I20260807 13:40:50.615126 24519 raft_consensus.cc:3037] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:50.610268 23600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 529) took 1430 ms. Trace:
I20260807 13:40:50.556104 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:50.631628 23818 raft_consensus.cc:2379] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 1: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:50.650084 23600 rpcz_store.cc:276] 0807 13:40:49.180121 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.540059 (+1359938us) service_pool.cc:227] Handling call
0807 13:40:50.540381 (+ 322us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.603594 (+ 63213us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.610199 (+ 6605us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.650581 23818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 278) took 1024 ms. Trace:
I20260807 13:40:50.650939 23818 rpcz_store.cc:276] 0807 13:40:49.625745 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.613770 (+988025us) service_pool.cc:227] Handling call
0807 13:40:50.650523 (+ 36753us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.611387 23555 leader_election.cc:302] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:50.557585 24748 leader_election.cc:288] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:50.656018 24748 raft_consensus.cc:482] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:50.656471 24748 raft_consensus.cc:504] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.658841 24833 raft_consensus.cc:2726] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:50.571120 23814 raft_consensus.cc:2379] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:50.659327 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:50.658605 24748 leader_election.cc:288] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:50.555317 23595 raft_consensus.cc:1226] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:50.641505 23825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 279) took 1015 ms. Trace:
I20260807 13:40:50.660501 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:50.660648 23825 rpcz_store.cc:276] 0807 13:40:49.626026 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.619700 (+993674us) service_pool.cc:227] Handling call
0807 13:40:50.641449 (+ 21749us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.661623 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4062e0223a4cc0b2e448e35445671d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:50.644587 23660 leader_election.cc:302] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:50.645582 23820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 256) took 1125 ms. Trace:
I20260807 13:40:50.603112 24742 raft_consensus.cc:482] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:50.662945 24742 raft_consensus.cc:3037] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:50.663542 23660 leader_election.cc:302] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:50.664449 24748 raft_consensus.cc:2781] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:50.664891 24748 raft_consensus.cc:686] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:50.665711 24748 consensus_queue.cc:237] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.661923 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:50.667563 23825 raft_consensus.cc:2379] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 2: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:50.668574 23599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 524) took 1489 ms. Trace:
I20260807 13:40:50.668143 23660 leader_election.cc:302] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:50.668975 23599 rpcz_store.cc:276] 0807 13:40:49.179234 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.375996 (+1196762us) service_pool.cc:227] Handling call
0807 13:40:50.376296 (+ 300us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:50.376608 (+ 312us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:50.376637 (+ 29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:50.377097 (+ 460us) log.cc:842] Serialized 26 byte log entry
0807 13:40:50.547040 (+169943us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:50.547077 (+ 37us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.547136 (+ 59us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:50.668352 (+121216us) raft_consensus.cc:1671] finished
0807 13:40:50.668378 (+ 26us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:50.668514 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1253,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"thread_start_us":169600,"threads_started":1,"wal-append.queue_time_us":254737}
I20260807 13:40:50.645696 24623 raft_consensus.cc:504] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.662410 23813 raft_consensus.cc:2379] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 1: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:50.645586 23769 leader_election.cc:302] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:50.648042 23711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 509) took 1823 ms. Trace:
I20260807 13:40:50.676472 23711 rpcz_store.cc:276] 0807 13:40:48.824310 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.536728 (+1712418us) service_pool.cc:227] Handling call
0807 13:40:50.647991 (+111263us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.568851 23590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 521) took 1388 ms. Trace:
I20260807 13:40:50.654839 23815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 255) took 1130 ms. Trace:
I20260807 13:40:50.655357 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 512) took 1779 ms. Trace:
I20260807 13:40:50.662281 23820 rpcz_store.cc:276] 0807 13:40:49.520258 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.621943 (+1101685us) service_pool.cc:227] Handling call
0807 13:40:50.645525 (+ 23582us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.694356 23702 rpcz_store.cc:276] 0807 13:40:48.876208 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.553566 (+1677358us) service_pool.cc:227] Handling call
0807 13:40:50.655297 (+101731us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.694938 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:50.696219 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:50.696254 23702 raft_consensus.cc:1226] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:50.647102 23823 rpcz_store.cc:276] 0807 13:40:49.622860 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.630529 (+1007669us) service_pool.cc:227] Handling call
0807 13:40:50.631501 (+ 972us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.697340 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 209) took 5557 ms. Trace:
I20260807 13:40:50.697943 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:50.698760 23823 raft_consensus.cc:2379] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 2: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:50.699152 23823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 251) took 1181 ms. Trace:
I20260807 13:40:50.669261 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:50.647329 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:50.699594 23823 rpcz_store.cc:276] 0807 13:40:49.518006 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.697711 (+1179705us) service_pool.cc:227] Handling call
0807 13:40:50.699103 (+ 1392us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.699929 23710 raft_consensus.cc:3037] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:50.700462 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:50.670590 23660 leader_election.cc:302] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:40:50.644282 24610 raft_consensus.cc:482] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:50.625541 24771 consensus_queue.cc:237] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.619313 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:50.653419 23555 leader_election.cc:302] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
W20260807 13:40:50.706002 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 52708.1us
I20260807 13:40:50.707056 23555 leader_election.cc:302] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:50.602178 23821 rpcz_store.cc:276] 0807 13:40:49.523401 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.270857 (+747456us) service_pool.cc:227] Handling call
0807 13:40:50.543118 (+272261us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.682401 23815 rpcz_store.cc:276] 0807 13:40:49.519969 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.630104 (+1110135us) service_pool.cc:227] Handling call
0807 13:40:50.650454 (+ 20350us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.683830 23711 raft_consensus.cc:1226] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:50.683642 24623 leader_election.cc:288] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:50.684250 23700 raft_consensus.cc:1226] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:50.721766 23711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 481) took 5582 ms. Trace:
I20260807 13:40:50.722325 23711 rpcz_store.cc:276] 0807 13:40:45.139171 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.677296 (+5538125us) service_pool.cc:227] Handling call
0807 13:40:50.683633 (+ 6337us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.721472 (+ 37839us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.721694 (+ 222us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.684780 24842 raft_consensus.cc:2781] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:50.686105 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:50.687817 23769 leader_election.cc:302] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:50.688263 23704 raft_consensus.cc:2454] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:50.690155 24667 raft_consensus.cc:504] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.651338 24605 raft_consensus.cc:482] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:50.727095 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 275) took 1299 ms. Trace:
I20260807 13:40:50.692093 24733 raft_consensus.cc:504] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.693305 23817 raft_consensus.cc:2379] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:50.681790 24834 raft_consensus.cc:504] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.693714 24799 raft_consensus.cc:2781] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:40:50.702320 23825 raft_consensus.cc:2379] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 2: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:50.723712 24832 raft_consensus.cc:2781] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:50.649876 24719 raft_consensus.cc:504] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.734719 23817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 275) took 1114 ms. Trace:
I20260807 13:40:50.735191 23814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 285) took 1095 ms. Trace:
I20260807 13:40:50.697974 23702 rpcz_store.cc:276] 0807 13:40:45.140040 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.695549 (+5555509us) service_pool.cc:227] Handling call
0807 13:40:50.695960 (+ 411us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.696907 (+ 947us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.697231 (+ 324us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.735719 23814 rpcz_store.cc:276] 0807 13:40:49.639964 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.419206 (+779242us) service_pool.cc:227] Handling call
0807 13:40:50.729341 (+310135us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54001f9d54. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:40:50.735124 (+ 5783us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":346667776}
I20260807 13:40:50.729625 24800 raft_consensus.cc:2781] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election won for term 1
W20260807 13:40:50.711059 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 105515us
I20260807 13:40:50.715862 23710 raft_consensus.cc:2454] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:50.778690 23707 raft_consensus.cc:1226] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:50.675894 23812 raft_consensus.cc:2379] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:50.717640 23555 leader_election.cc:302] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:50.779771 24739 raft_consensus.cc:3037] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:40:50.779810 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 62278.7us
I20260807 13:40:50.781118 23707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 478) took 5643 ms. Trace:
I20260807 13:40:50.720745 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:50.676059 24651 raft_consensus.cc:504] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.704174 24610 raft_consensus.cc:504] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.714943 23595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 531) took 1470 ms. Trace:
I20260807 13:40:50.717073 24833 raft_consensus.cc:3037] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:50.720013 24795 raft_consensus.cc:2781] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:40:50.727514 23703 rpcz_store.cc:276] 0807 13:40:49.427588 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.423139 (+995551us) service_pool.cc:227] Handling call
0807 13:40:50.726924 (+303785us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b540029f9d4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:40:50.727044 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":678257536}
I20260807 13:40:50.728756 23711 raft_consensus.cc:1226] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:50.697351 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:50.730997 24799 raft_consensus.cc:482] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:50.737739 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:50.728112 24842 raft_consensus.cc:686] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:50.729303 24605 raft_consensus.cc:504] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.745122 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 479) took 5594 ms. Trace:
I20260807 13:40:50.727681 23705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 517) took 1597 ms. Trace:
I20260807 13:40:50.746227 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:50.732908 24832 raft_consensus.cc:482] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:50.678025 23590 rpcz_store.cc:276] 0807 13:40:49.178505 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.335422 (+1156917us) service_pool.cc:227] Handling call
0807 13:40:50.335800 (+ 378us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:50.337092 (+ 1292us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:50.343376 (+ 6284us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:50.343983 (+ 607us) log.cc:842] Serialized 26 byte log entry
0807 13:40:50.434680 (+ 90697us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:50.443430 (+ 8750us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.482844 (+ 39414us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:50.537527 (+ 54683us) raft_consensus.cc:1671] finished
0807 13:40:50.549006 (+ 11479us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:50.566611 (+ 17605us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":116,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"thread_start_us":63241,"threads_started":1,"wal-append.queue_time_us":75802}
I20260807 13:40:50.708017 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:50.722019 24742 raft_consensus.cc:504] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.727594 24846 raft_consensus.cc:2781] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:50.766718 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 536) took 1370 ms. Trace:
I20260807 13:40:50.719744 24781 raft_consensus.cc:686] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:50.772056 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:50.772519 23769 leader_election.cc:302] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:50.735276 23817 rpcz_store.cc:276] 0807 13:40:49.620436 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.571125 (+950689us) service_pool.cc:227] Handling call
0807 13:40:50.734628 (+163503us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.774868 24667 leader_election.cc:288] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:50.831055 23699 raft_consensus.cc:1226] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:50.775167 24519 raft_consensus.cc:504] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.775983 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:50.832604 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 482) took 5693 ms. Trace:
I20260807 13:40:50.833060 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:50.832950 23699 rpcz_store.cc:276] 0807 13:40:45.139465 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.694821 (+5555356us) service_pool.cc:227] Handling call
0807 13:40:50.695731 (+ 910us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.831630 (+135899us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.832394 (+ 764us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b5400380ed4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:40:50.832548 (+ 154us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":301265664}
I20260807 13:40:50.833700 24519 leader_election.cc:288] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:50.833958 23814 raft_consensus.cc:2354] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
I20260807 13:40:50.834309 24846 raft_consensus.cc:686] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:50.834846 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:50.835233 24846 consensus_queue.cc:237] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.836377 24605 leader_election.cc:288] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:50.777236 24733 leader_election.cc:288] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:50.817875 23709 raft_consensus.cc:3037] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:50.777776 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
W20260807 13:40:50.778719 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 108199us
I20260807 13:40:50.837476 23825 raft_consensus.cc:3037] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:50.781208 23555 leader_election.cc:302] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:50.839589 23817 raft_consensus.cc:1226] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: []
W20260807 13:40:50.840065 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 58925.4us
I20260807 13:40:50.840237 23817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45360 (request call id 436) took 2328 ms. Trace:
I20260807 13:40:50.840801 23555 leader_election.cc:302] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:50.781878 23823 raft_consensus.cc:3037] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:50.783353 23710 raft_consensus.cc:1226] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:50.842489 23710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 483) took 5267 ms. Trace:
I20260807 13:40:50.815925 24799 raft_consensus.cc:3037] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:50.782421 23554 leader_election.cc:302] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:50.814709 23711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 210) took 5674 ms. Trace:
I20260807 13:40:50.842816 23710 rpcz_store.cc:276] 0807 13:40:45.575611 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.782745 (+5207134us) service_pool.cc:227] Handling call
0807 13:40:50.783180 (+ 435us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.842273 (+ 59093us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.842440 (+ 167us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.844107 23711 rpcz_store.cc:276] 0807 13:40:45.140357 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.723159 (+5582802us) service_pool.cc:227] Handling call
0807 13:40:50.728635 (+ 5476us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.814427 (+ 85792us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.814631 (+ 204us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.846047 23710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 485) took 4777 ms. Trace:
I20260807 13:40:50.816777 23812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 274) took 1220 ms. Trace:
I20260807 13:40:50.846474 23710 rpcz_store.cc:276] 0807 13:40:46.069071 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.845271 (+4776200us) service_pool.cc:227] Handling call
0807 13:40:50.845542 (+ 271us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.845754 (+ 212us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:50.845779 (+ 25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:50.845818 (+ 39us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:50.845843 (+ 25us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.845893 (+ 50us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:50.845989 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.846645 23812 rpcz_store.cc:276] 0807 13:40:49.598332 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.555803 (+957471us) service_pool.cc:227] Handling call
0807 13:40:50.816698 (+260895us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":12672}
I20260807 13:40:50.813839 23820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 253) took 1295 ms. Trace:
I20260807 13:40:50.824512 24832 raft_consensus.cc:3037] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:50.798622 23449 catalog_manager.cc:5495] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 0 to 1, leader changed from <none> to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 1 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:50.848074 23820 rpcz_store.cc:276] 0807 13:40:49.518461 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.697082 (+1178621us) service_pool.cc:227] Handling call
0807 13:40:50.813767 (+116685us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.784024 24651 leader_election.cc:288] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:50.823153 23818 raft_consensus.cc:3037] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:50.783604 23588 raft_consensus.cc:1226] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:50.849558 23449 catalog_manager.cc:5495] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 0 to 1, leader changed from <none> to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 1 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:50.781890 24834 leader_election.cc:288] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:50.826241 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 484) took 5250 ms. Trace:
I20260807 13:40:50.836526 23814 raft_consensus.cc:1226] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 13:40:50.783895 24800 raft_consensus.cc:686] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:50.784109 24719 leader_election.cc:288] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:50.815483 23747 debug-util.cc:398] Leaking SignalData structure 0x7b0800164500 after lost signal to thread 21836
W20260807 13:40:50.828060 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 55639.8us
I20260807 13:40:50.882102 23769 leader_election.cc:302] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:50.882535 23711 raft_consensus.cc:1226] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 3. Current term is 4. Ops: []
I20260807 13:40:50.883805 23711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 231) took 4804 ms. Trace:
I20260807 13:40:50.884210 23711 rpcz_store.cc:276] 0807 13:40:46.079042 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.845403 (+4766361us) service_pool.cc:227] Handling call
0807 13:40:50.882300 (+ 36897us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.883478 (+ 1178us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.883734 (+ 256us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.825338 23704 rpcz_store.cc:276] 0807 13:40:49.364491 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.374460 (+1009969us) service_pool.cc:227] Handling call
0807 13:40:50.731825 (+357365us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.737149 23813 raft_consensus.cc:2379] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 2: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:50.844071 23825 raft_consensus.cc:2454] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:50.887126 23825 raft_consensus.cc:1226] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:50.887707 23825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45360 (request call id 448) took 2357 ms. Trace:
I20260807 13:40:50.888005 23825 rpcz_store.cc:276] 0807 13:40:48.530186 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.886580 (+2356394us) service_pool.cc:227] Handling call
0807 13:40:50.886957 (+ 377us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.887503 (+ 546us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.887659 (+ 156us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.888950 23823 raft_consensus.cc:2454] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:50.889202 23825 raft_consensus.cc:1226] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:50.781517 23707 rpcz_store.cc:276] 0807 13:40:45.138107 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.630101 (+5491994us) service_pool.cc:227] Handling call
0807 13:40:50.630370 (+ 269us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.780331 (+149961us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.780900 (+ 569us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b5400071054. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:40:50.781063 (+ 163us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":245138688}
I20260807 13:40:50.853669 23703 rpcz_store.cc:276] 0807 13:40:45.575977 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.815881 (+5239904us) service_pool.cc:227] Handling call
0807 13:40:50.825731 (+ 9850us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.825910 (+ 179us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:50.825935 (+ 25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:50.825977 (+ 42us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:50.826011 (+ 34us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.826064 (+ 53us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:50.826183 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.814371 24795 raft_consensus.cc:482] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:50.814029 23595 rpcz_store.cc:276] 0807 13:40:49.233970 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.554802 (+1320832us) service_pool.cc:227] Handling call
0807 13:40:50.555124 (+ 322us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.678117 (+122993us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.704747 (+ 26630us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.855362 24651 raft_consensus.cc:3037] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:50.856109 23588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 515) took 1679 ms. Trace:
I20260807 13:40:50.856238 23820 raft_consensus.cc:1226] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260807 13:40:50.903366 23820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45360 (request call id 442) took 2389 ms. Trace:
I20260807 13:40:50.903703 23820 rpcz_store.cc:276] 0807 13:40:48.513737 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.849022 (+2335285us) service_pool.cc:227] Handling call
0807 13:40:50.856002 (+ 6980us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:50.903101 (+ 47099us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.903313 (+ 212us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.820689 23705 rpcz_store.cc:276] 0807 13:40:49.129208 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.619044 (+1489836us) service_pool.cc:227] Handling call
0807 13:40:50.726596 (+107552us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.858712 23818 raft_consensus.cc:2454] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:50.859263 24781 consensus_queue.cc:237] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.843295 24667 raft_consensus.cc:3037] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:50.818311 23700 rpcz_store.cc:276] 0807 13:40:45.138417 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.635275 (+5496858us) service_pool.cc:227] Handling call
0807 13:40:50.676756 (+ 41481us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.725445 (+ 48689us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.732566 (+ 7121us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.861119 24842 consensus_queue.cc:237] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.840560 23817 rpcz_store.cc:276] 0807 13:40:48.512073 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.839080 (+2327007us) service_pool.cc:227] Handling call
0807 13:40:50.839402 (+ 322us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.839994 (+ 592us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.840181 (+ 187us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.867077 24742 leader_election.cc:288] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:50.868846 24610 leader_election.cc:288] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:50.901839 23825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45360 (request call id 449) took 2371 ms. Trace:
I20260807 13:40:50.914484 23825 rpcz_store.cc:276] 0807 13:40:48.530472 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.888806 (+2358334us) service_pool.cc:227] Handling call
0807 13:40:50.889060 (+ 254us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.898877 (+ 9817us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.901753 (+ 2876us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.909567 23823 raft_consensus.cc:1226] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:50.892741 23815 raft_consensus.cc:2379] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:50.912810 23818 raft_consensus.cc:1226] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 13:40:50.895426 24644 raft_consensus.cc:2781] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:50.930869 23818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45370 (request call id 261) took 1409 ms. Trace:
I20260807 13:40:50.939159 23823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45360 (request call id 450) took 2408 ms. Trace:
I20260807 13:40:50.918568 23703 raft_consensus.cc:1226] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:50.900594 24795 raft_consensus.cc:3037] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:50.892823 24745 raft_consensus.cc:2741] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260807 13:40:50.901302 24719 raft_consensus.cc:2726] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:50.940900 23818 rpcz_store.cc:276] 0807 13:40:49.521619 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.912091 (+1390472us) service_pool.cc:227] Handling call
0807 13:40:50.912523 (+ 432us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:50.930483 (+ 17960us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.930806 (+ 323us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.940937 23823 rpcz_store.cc:276] 0807 13:40:48.530778 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.889562 (+2358784us) service_pool.cc:227] Handling call
0807 13:40:50.889799 (+ 237us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.938893 (+ 49094us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.939101 (+ 208us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.942900 23820 raft_consensus.cc:1226] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 13:40:50.945864 23820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45360 (request call id 454) took 2129 ms. Trace:
I20260807 13:40:50.945819 23769 leader_election.cc:302] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:50.907418 24583 consensus_queue.cc:1046] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.038s
I20260807 13:40:50.949434 23813 raft_consensus.cc:1226] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 13:40:50.950196 23813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45370 (request call id 267) took 1426 ms. Trace:
I20260807 13:40:50.950541 23813 rpcz_store.cc:276] 0807 13:40:49.523581 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.915203 (+1391622us) service_pool.cc:227] Handling call
0807 13:40:50.949129 (+ 33926us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:50.949902 (+ 773us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.950134 (+ 232us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.950418 24800 consensus_queue.cc:237] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:50.951433 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 493) took 2570 ms. Trace:
W20260807 13:40:50.952229 21838 debug-util.cc:398] Leaking SignalData structure 0x7b080000eac0 after lost signal to thread 23769
I20260807 13:40:50.913722 23814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45360 (request call id 421) took 2403 ms. Trace:
I20260807 13:40:50.953482 23814 rpcz_store.cc:276] 0807 13:40:48.508292 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.835920 (+2327628us) service_pool.cc:227] Handling call
0807 13:40:50.836241 (+ 321us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:50.882952 (+ 46711us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.911363 (+ 28411us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.954731 23705 raft_consensus.cc:1226] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:50.955439 23705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 496) took 2519 ms. Trace:
I20260807 13:40:50.955767 23705 rpcz_store.cc:276] 0807 13:40:48.435708 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.954191 (+2518483us) service_pool.cc:227] Handling call
0807 13:40:50.954525 (+ 334us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.955182 (+ 657us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.955386 (+ 204us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.957355 23705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 497) took 2512 ms. Trace:
I20260807 13:40:50.957708 23705 rpcz_store.cc:276] 0807 13:40:48.445062 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.956540 (+2511478us) service_pool.cc:227] Handling call
0807 13:40:50.956848 (+ 308us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.957030 (+ 182us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:50.957059 (+ 29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:50.957098 (+ 39us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:40:50.957128 (+ 30us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.957184 (+ 56us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:50.957302 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.960644 23711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 487) took 4489 ms. Trace:
I20260807 13:40:50.960983 23711 rpcz_store.cc:276] 0807 13:40:46.471362 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.898331 (+4426969us) service_pool.cc:227] Handling call
0807 13:40:50.959991 (+ 61660us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b5800004598. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f46210032b0 00007f4620fee7f9 00007f4620fee2a2 00007f461a6d4684
0807 13:40:50.960179 (+ 188us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.960362 (+ 183us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:50.960389 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:50.960423 (+ 34us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:50.960450 (+ 27us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.960496 (+ 46us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:50.960591 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3711232}
I20260807 13:40:50.961738 23709 raft_consensus.cc:2454] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:50.963019 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 492) took 2582 ms. Trace:
I20260807 13:40:50.963407 23704 rpcz_store.cc:276] 0807 13:40:48.380971 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.901484 (+2520513us) service_pool.cc:227] Handling call
0807 13:40:50.962324 (+ 60840us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b5800004598. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f46210032b0 00007f4620fee7f9 00007f4620fee2a2 00007f461a6d4684
0807 13:40:50.962508 (+ 184us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.962693 (+ 185us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:50.962725 (+ 32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:50.962769 (+ 44us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:50.962806 (+ 37us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.962863 (+ 57us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:50.962964 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4498688}
I20260807 13:40:50.931241 23702 raft_consensus.cc:1226] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:50.951869 23700 rpcz_store.cc:276] 0807 13:40:48.381352 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.930880 (+2549528us) service_pool.cc:227] Handling call
0807 13:40:50.950881 (+ 20001us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.951075 (+ 194us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:50.951103 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:50.951150 (+ 47us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:40:50.951179 (+ 29us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.951235 (+ 56us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:50.951374 (+ 139us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.965277 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 222) took 5561 ms. Trace:
I20260807 13:40:50.965359 24739 raft_consensus.cc:2726] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:50.965763 23702 rpcz_store.cc:276] 0807 13:40:45.404320 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.737026 (+5332706us) service_pool.cc:227] Handling call
0807 13:40:50.773726 (+ 36700us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.964490 (+190764us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.965028 (+ 538us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b540007f654. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:40:50.965207 (+ 179us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":312424832}
I20260807 13:40:50.967849 23699 raft_consensus.cc:1226] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 13:40:50.968590 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 232) took 4889 ms. Trace:
I20260807 13:40:50.968931 23699 rpcz_store.cc:276] 0807 13:40:46.079375 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.853935 (+4774560us) service_pool.cc:227] Handling call
0807 13:40:50.938893 (+ 84958us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:50.968298 (+ 29405us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.968531 (+ 233us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.970074 23812 raft_consensus.cc:1226] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: []
W20260807 13:40:50.942042 23747 debug-util.cc:398] Leaking SignalData structure 0x7b08000a6460 after lost signal to thread 23513
I20260807 13:40:50.970743 23812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45360 (request call id 444) took 2456 ms. Trace:
I20260807 13:40:50.971279 23812 rpcz_store.cc:276] 0807 13:40:48.514384 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.893590 (+2379206us) service_pool.cc:227] Handling call
0807 13:40:50.969862 (+ 76272us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.970469 (+ 607us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.970675 (+ 206us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.902984 23588 rpcz_store.cc:276] 0807 13:40:49.176919 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.256681 (+1079762us) service_pool.cc:227] Handling call
0807 13:40:50.256999 (+ 318us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.855136 (+598137us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.855872 (+ 736us) spinlock_profiling.cc:243] Waited 526 ms on lock 0x7b54003b6354. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:40:50.856052 (+ 180us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1210650496}
I20260807 13:40:50.995499 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 257) took 2793 ms. Trace:
I20260807 13:40:50.996163 23703 rpcz_store.cc:276] 0807 13:40:48.202166 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.901060 (+2698894us) service_pool.cc:227] Handling call
0807 13:40:50.918338 (+ 17278us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:50.948548 (+ 30210us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.995415 (+ 46867us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:50.957820 24832 raft_consensus.cc:504] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.010506 23823 raft_consensus.cc:1226] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
W20260807 13:40:51.016206 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 233845us
I20260807 13:40:51.020190 23823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45370 (request call id 289) took 1378 ms. Trace:
I20260807 13:40:51.020332 23554 leader_election.cc:302] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:51.020603 23823 rpcz_store.cc:276] 0807 13:40:49.641693 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.943432 (+1301739us) service_pool.cc:227] Handling call
0807 13:40:51.010240 (+ 66808us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:51.019616 (+ 9376us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:51.020132 (+ 516us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:51.012485 24858 raft_consensus.cc:2781] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election won for term 3
W20260807 13:40:51.015677 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 174931us
I20260807 13:40:50.946568 23820 rpcz_store.cc:276] 0807 13:40:48.816653 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.909100 (+2092447us) service_pool.cc:227] Handling call
0807 13:40:50.942558 (+ 33458us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:50.945567 (+ 3009us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:50.945805 (+ 238us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:40:51.021929 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 76252.5us
I20260807 13:40:51.022490 23707 raft_consensus.cc:1226] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:51.012948 24833 raft_consensus.cc:2726] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:51.027367 23707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 237) took 4532 ms. Trace:
I20260807 13:40:51.025449 23555 leader_election.cc:302] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:51.027714 23707 rpcz_store.cc:276] 0807 13:40:46.494647 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.889751 (+4395104us) service_pool.cc:227] Handling call
0807 13:40:50.890030 (+ 279us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:51.026553 (+136523us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:51.027131 (+ 578us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b540035b1d4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:40:51.027314 (+ 183us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":304133888}
I20260807 13:40:51.029054 23707 raft_consensus.cc:1226] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:51.030350 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 498) took 2581 ms. Trace:
I20260807 13:40:51.030807 23703 rpcz_store.cc:276] 0807 13:40:48.448687 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:51.007057 (+2558370us) service_pool.cc:227] Handling call
0807 13:40:51.029762 (+ 22705us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:51.029962 (+ 200us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:51.029997 (+ 35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:51.030049 (+ 52us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:51.030090 (+ 41us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:51.030154 (+ 64us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:51.030274 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:51.032917 23554 leader_election.cc:302] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:51.040633 23707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 501) took 2550 ms. Trace:
I20260807 13:40:51.041163 23707 rpcz_store.cc:276] 0807 13:40:48.490034 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:51.028605 (+2538571us) service_pool.cc:227] Handling call
0807 13:40:51.028902 (+ 297us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:51.038842 (+ 9940us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:51.040555 (+ 1713us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:51.042744 24719 raft_consensus.cc:2726] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:51.045153 24719 raft_consensus.cc:2781] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:51.045581 24719 raft_consensus.cc:482] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:51.045997 24719 raft_consensus.cc:3037] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:51.048604 23554 leader_election.cc:302] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:51.049293 23555 leader_election.cc:302] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:51.053721 23707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 503) took 2546 ms. Trace:
I20260807 13:40:51.054953 24856 raft_consensus.cc:2781] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:51.055222 24860 consensus_queue.cc:1046] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:51.055981 24739 raft_consensus.cc:2781] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:51.056376 24739 raft_consensus.cc:482] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:51.056743 24739 raft_consensus.cc:3037] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:51.057548 24745 consensus_queue.cc:1046] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:51.055539 24856 raft_consensus.cc:686] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:51.059706 24856 consensus_queue.cc:237] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.060133 24832 leader_election.cc:288] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:51.050408 24799 raft_consensus.cc:504] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.050280 24833 raft_consensus.cc:2781] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:51.062844 23818 raft_consensus.cc:1226] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:40:51.062991 24833 raft_consensus.cc:686] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:51.063745 24799 leader_election.cc:288] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:51.063957 24833 consensus_queue.cc:237] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.065562 23818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45370 (request call id 288) took 1424 ms. Trace:
I20260807 13:40:51.067655 23818 rpcz_store.cc:276] 0807 13:40:49.641296 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.942000 (+1300704us) service_pool.cc:227] Handling call
0807 13:40:50.942257 (+ 257us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:51.063237 (+120980us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:51.065314 (+ 2077us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54002837d4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:40:51.065507 (+ 193us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":276723968}
I20260807 13:40:51.069612 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 507) took 2247 ms. Trace:
I20260807 13:40:51.067163 23711 raft_consensus.cc:1226] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:51.067112 23705 raft_consensus.cc:1226] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:51.071833 23555 leader_election.cc:302] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:51.054184 23707 rpcz_store.cc:276] 0807 13:40:48.501913 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:51.042071 (+2540158us) service_pool.cc:227] Handling call
0807 13:40:51.048090 (+ 6019us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:51.048287 (+ 197us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:51.048310 (+ 23us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:51.048362 (+ 52us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:51.048389 (+ 27us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:51.048445 (+ 56us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:51.048542 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:51.074527 23711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 506) took 2545 ms. Trace:
I20260807 13:40:51.074863 23555 leader_election.cc:302] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:51.074921 23711 rpcz_store.cc:276] 0807 13:40:48.528769 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:51.052174 (+2523405us) service_pool.cc:227] Handling call
0807 13:40:51.066999 (+ 14825us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:51.074238 (+ 7239us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:51.074459 (+ 221us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:51.076049 23555 leader_election.cc:302] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:51.070072 23699 rpcz_store.cc:276] 0807 13:40:48.821748 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:51.068135 (+2246387us) service_pool.cc:227] Handling call
0807 13:40:51.068616 (+ 481us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:51.069046 (+ 430us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:51.069107 (+ 61us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:51.069153 (+ 46us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:51.069223 (+ 70us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:51.069345 (+ 122us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:51.069548 (+ 203us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:51.055981 24860 consensus_queue.cc:1225] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer 8a3af1d071e74f2eb0c821e2bd68fe37 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260807 13:40:51.087224 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 59443.1us
I20260807 13:40:51.077191 24853 raft_consensus.cc:2781] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:51.091279 23769 leader_election.cc:302] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
W20260807 13:40:51.084503 23747 debug-util.cc:398] Leaking SignalData structure 0x7b0800345780 after lost signal to thread 23637
I20260807 13:40:51.076640 24583 raft_consensus.cc:3032] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:51.081568 24859 raft_consensus.cc:3032] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:51.089965 24853 raft_consensus.cc:482] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:51.080331 24742 raft_consensus.cc:2781] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:51.081406 24667 raft_consensus.cc:2726] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:51.108071 24856 raft_consensus.cc:2781] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:51.095180 24583 raft_consensus.cc:729] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:51.108615 24860 consensus_queue.cc:1046] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:51.110296 24860 raft_consensus.cc:2781] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:51.110852 24860 raft_consensus.cc:686] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:51.111788 24860 consensus_queue.cc:237] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.113759 24861 raft_consensus.cc:3032] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:51.114181 24861 raft_consensus.cc:729] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:51.108659 24856 raft_consensus.cc:686] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:51.115361 24861 consensus_queue.cc:260] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.091926 23821 raft_consensus.cc:1226] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
W20260807 13:40:51.097411 23747 debug-util.cc:398] Leaking SignalData structure 0x7b08003457a0 after lost signal to thread 23638
I20260807 13:40:51.093458 23705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 500) took 2610 ms. Trace:
W20260807 13:40:51.099269 24852 log.cc:924] Time spent T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da: Append to log took a long time: real 0.077s user 0.000s sys 0.002s
I20260807 13:40:51.134352 23825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45370 (request call id 280) took 1508 ms. Trace:
I20260807 13:40:51.097998 24859 raft_consensus.cc:729] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:51.134936 23825 rpcz_store.cc:276] 0807 13:40:49.626345 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.915518 (+1289173us) service_pool.cc:227] Handling call
0807 13:40:50.915963 (+ 445us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:51.023607 (+107644us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:51.023626 (+ 19us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:51.025314 (+ 1688us) log.cc:842] Serialized 26 byte log entry
0807 13:40:51.089095 (+ 63781us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:51.089140 (+ 45us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:51.089211 (+ 71us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:51.134006 (+ 44795us) raft_consensus.cc:1671] finished
0807 13:40:51.134036 (+ 30us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:51.134251 (+ 215us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":94957,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":170,"thread_start_us":167749,"threads_started":2,"wal-append.queue_time_us":104740}
I20260807 13:40:51.103304 24853 raft_consensus.cc:3037] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:51.103324 24742 raft_consensus.cc:482] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:51.092826 24644 raft_consensus.cc:686] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:51.131165 24861 raft_consensus.cc:3037] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:51.126256 23704 raft_consensus.cc:1226] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
W20260807 13:40:51.157642 23747 debug-util.cc:398] Leaking SignalData structure 0x7b0800252880 after lost signal to thread 23751
I20260807 13:40:51.193122 23703 raft_consensus.cc:1226] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:51.167353 24742 raft_consensus.cc:3037] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:51.140506 24583 consensus_queue.cc:260] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.158439 24651 raft_consensus.cc:2726] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:51.159238 24799 raft_consensus.cc:3032] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:51.154752 23821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45360 (request call id 445) took 2630 ms. Trace:
I20260807 13:40:51.126617 23705 rpcz_store.cc:276] 0807 13:40:48.481578 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:51.017049 (+2535471us) service_pool.cc:227] Handling call
0807 13:40:51.052667 (+ 35618us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:51.077359 (+ 24692us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:51.091873 (+ 14514us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:51.190961 24842 raft_consensus.cc:482] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:51.154285 24739 raft_consensus.cc:504] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.141422 24856 consensus_queue.cc:237] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.159910 24859 consensus_queue.cc:260] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.204710 23821 rpcz_store.cc:276] 0807 13:40:48.524188 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.957749 (+2433561us) service_pool.cc:227] Handling call
0807 13:40:51.051579 (+ 93830us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:51.127168 (+ 75589us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:51.141401 (+ 14233us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:51.213325 24859 raft_consensus.cc:3037] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:51.156232 24795 raft_consensus.cc:504] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.213370 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 502) took 2717 ms. Trace:
I20260807 13:40:51.216068 23703 rpcz_store.cc:276] 0807 13:40:48.495514 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:51.031993 (+2536479us) service_pool.cc:227] Handling call
0807 13:40:51.053512 (+ 21519us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:51.193805 (+140293us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:51.213091 (+ 19286us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54003818d4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:40:51.213314 (+ 223us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":316215168}
I20260807 13:40:51.217799 24644 consensus_queue.cc:237] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.207809 24842 raft_consensus.cc:504] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:51.225462 24857 log.cc:924] Time spent T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.116s user 0.002s sys 0.002s
I20260807 13:40:51.204303 24799 raft_consensus.cc:729] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:51.223141 24842 leader_election.cc:288] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:51.228124 23747 debug-util.cc:398] Leaking SignalData structure 0x7b0800333360 after lost signal to thread 23861
I20260807 13:40:51.227522 24799 consensus_queue.cc:260] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.229421 24799 raft_consensus.cc:3037] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:51.231350 23710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 486) took 4760 ms. Trace:
I20260807 13:40:51.231176 24583 raft_consensus.cc:3037] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:51.231768 23710 rpcz_store.cc:276] 0807 13:40:46.470983 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.887595 (+4416612us) service_pool.cc:227] Handling call
0807 13:40:50.887895 (+ 300us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:50.888337 (+ 442us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:50.888367 (+ 30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:50.888760 (+ 393us) log.cc:842] Serialized 26 byte log entry
0807 13:40:51.086305 (+197545us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:51.086364 (+ 59us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:51.086458 (+ 94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:51.224703 (+138245us) spinlock_profiling.cc:243] Waited 8.09 ms on lock 0x7b44000232cc. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f4619097a95 00007f46190984b2 00007f461bd40511 00007f461bd3be1a 00007f461bd2fbee 00007f461bd2ef36 00007f461bd2eb58 00007f461bd38551 00007f461bd38509 00007f461bd38499
0807 13:40:51.231015 (+ 6312us) raft_consensus.cc:1671] finished
0807 13:40:51.231037 (+ 22us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:51.231283 (+ 246us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":126,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":13844,"spinlock_wait_cycles":18602880,"thread_start_us":169849,"threads_started":1,"wal-append.queue_time_us":201863}
I20260807 13:40:51.205044 24858 raft_consensus.cc:686] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:51.232888 24739 leader_election.cc:288] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:51.251277 24719 raft_consensus.cc:504] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.256319 24795 leader_election.cc:288] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:51.259207 24858 consensus_queue.cc:237] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.254563 24719 leader_election.cc:288] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:51.342268 23554 leader_election.cc:334] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Timed out: RequestConsensusVote RPC to 127.21.82.67:46685 timed out after 1.796s (SENT)
I20260807 13:40:51.343703 23554 leader_election.cc:302] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:51.348419 24888 raft_consensus.cc:2726] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 13:40:51.360473 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 284314us
W20260807 13:40:51.397127 23554 leader_election.cc:334] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Timed out: RequestConsensusVote RPC to 127.21.82.67:46685 timed out after 1.979s (SENT)
I20260807 13:40:51.397686 24853 raft_consensus.cc:504] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:51.400604 23554 leader_election.cc:334] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Timed out: RequestConsensusVote RPC to 127.21.82.67:46685 timed out after 1.980s (SENT)
I20260807 13:40:51.403697 23554 leader_election.cc:302] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:51.404891 24856 raft_consensus.cc:2726] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:51.406349 24853 leader_election.cc:288] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:51.407713 24742 raft_consensus.cc:504] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.425802 23555 leader_election.cc:302] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
W20260807 13:40:51.429590 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 338257us
I20260807 13:40:51.434931 24853 raft_consensus.cc:3037] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:51.423050 24742 leader_election.cc:288] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:51.436458 23769 leader_election.cc:302] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:51.438256 23817 raft_consensus.cc:1226] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 13:40:51.440904 24860 raft_consensus.cc:2726] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:51.441834 24860 consensus_queue.cc:1046] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:51.441653 24876 consensus_queue.cc:1046] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:51.443138 24876 raft_consensus.cc:3032] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:51.443471 24860 raft_consensus.cc:3032] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:51.443605 24876 raft_consensus.cc:729] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:51.443917 24860 raft_consensus.cc:729] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:51.445312 24876 consensus_queue.cc:260] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.437121 24742 raft_consensus.cc:482] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:51.440968 23817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45370 (request call id 286) took 1800 ms. Trace:
I20260807 13:40:51.446774 24742 raft_consensus.cc:504] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.448005 23769 leader_election.cc:302] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:51.449162 24872 raft_consensus.cc:2781] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:51.449563 24742 leader_election.cc:288] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:51.449730 24872 raft_consensus.cc:686] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:51.447359 23817 rpcz_store.cc:276] 0807 13:40:49.640559 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:50.930838 (+1290279us) service_pool.cc:227] Handling call
0807 13:40:50.951973 (+ 21135us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:51.439094 (+487121us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:51.440440 (+ 1346us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b54002260d4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:40:51.440788 (+ 348us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1116836736}
I20260807 13:40:51.445253 24860 consensus_queue.cc:260] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
I20260807 13:40:51.451378 24872 consensus_queue.cc:237] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.455076 24860 raft_consensus.cc:3037] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:51.460605 24853 raft_consensus.cc:2726] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:51.451354 24876 raft_consensus.cc:3037] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:51.470011 23447 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37954 (request call id 128) took 3755 ms. Trace:
W20260807 13:40:51.475409 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 52012.5us
I20260807 13:40:51.483314 23555 leader_election.cc:302] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:51.484817 24583 consensus_queue.cc:1046] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:51.486537 24583 raft_consensus.cc:3032] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:51.487246 24583 raft_consensus.cc:729] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:51.487638 24853 raft_consensus.cc:2726] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:51.488989 24583 consensus_queue.cc:260] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.491019 24583 raft_consensus.cc:3037] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:51.470515 23447 rpcz_store.cc:276] 0807 13:40:47.732150 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:47.754130 (+ 21980us) service_pool.cc:227] Handling call
0807 13:40:51.469685 (+3715555us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:40:50.738596 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:40:50.775298 (+ 36702us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:40:50.775339 (+ 41us) write_op.cc:435] Acquired schema lock
0807 13:40:50.775355 (+ 16us) tablet.cc:660] Decoding operations
0807 13:40:50.776214 (+ 859us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:40:50.776480 (+ 266us) write_op.cc:641] Partition lock acquired for write op
0807 13:40:50.776505 (+ 25us) tablet.cc:683] Acquiring locks for 5 operations
0807 13:40:50.777020 (+ 515us) tablet.cc:699] Row locks acquired
0807 13:40:50.777039 (+ 19us) write_op.cc:260] PREPARE: finished
0807 13:40:50.777173 (+ 134us) write_op.cc:270] Start()
0807 13:40:50.777276 (+ 103us) write_op.cc:276] Timestamp: P: 1786110050777128 usec, L: 0
0807 13:40:50.777294 (+ 18us) op_driver.cc:331] REPLICATION: starting
0807 13:40:50.789401 (+ 12107us) log.cc:842] Serialized 2078 byte log entry
0807 13:40:51.260389 (+470988us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b180014bde0. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f46220248b1 00007f4622031661 00007f4619185638 00007f4619188b11 00007f4619188ac9 00007f4619188a59 00007f4619188a21 00007f4619187d1d 00007f46223e9204 00007f46223e9039 00007f4619167dc6
0807 13:40:51.260752 (+ 363us) op_driver.cc:444] REPLICATION: finished
0807 13:40:51.403791 (+143039us) write_op.cc:301] APPLY: starting
0807 13:40:51.404053 (+ 262us) tablet.cc:1365] starting BulkCheckPresence
0807 13:40:51.404335 (+ 282us) tablet.cc:1368] finished BulkCheckPresence
0807 13:40:51.404380 (+ 45us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:40:51.405658 (+ 1278us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:40:51.406140 (+ 482us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0807 13:40:51.406230 (+ 90us) write_op.cc:312] APPLY: finished
0807 13:40:51.407025 (+ 795us) log.cc:842] Serialized 46 byte log entry
0807 13:40:51.407359 (+ 334us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:40:51.407632 (+ 273us) write_op.cc:454] Released schema lock
0807 13:40:51.407751 (+ 119us) write_op.cc:341] FINISH: Updating metrics
0807 13:40:51.408254 (+ 503us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:40:51.408300 (+ 46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":818345,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":142527,"apply.run_cpu_time_us":5047,"apply.run_wall_time_us":5174,"mutex_wait_us":3155,"num_ops":5,"prepare.queue_time_us":61875,"prepare.run_cpu_time_us":48104,"prepare.run_wall_time_us":192674,"raft.queue_time_us":261809,"raft.run_cpu_time_us":18743,"raft.run_wall_time_us":154871,"replication_time_us":483291,"spinlock_wait_cycles":24918912,"thread_start_us":347786,"threads_started":4,"wal-append.queue_time_us":232920}]]}
I20260807 13:40:51.499475 24861 consensus_queue.cc:1046] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:51.500981 24872 raft_consensus.cc:3032] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:51.501467 24872 raft_consensus.cc:729] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:51.502903 24861 consensus_queue.cc:1046] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:51.503013 24872 consensus_queue.cc:260] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.504029 24861 consensus_queue.cc:1225] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer 8a3af1d071e74f2eb0c821e2bd68fe37 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260807 13:40:51.504864 24872 raft_consensus.cc:3037] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:51.504860 24644 raft_consensus.cc:3032] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:51.505663 24644 raft_consensus.cc:729] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:51.507858 23555 leader_election.cc:302] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:51.508695 23554 leader_election.cc:302] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:51.510157 24742 raft_consensus.cc:2781] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:51.511822 24644 consensus_queue.cc:260] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.516222 24644 raft_consensus.cc:3037] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:51.516469 23554 leader_election.cc:302] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:51.519896 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f8a5f186bf1473a988921e5efa3e574" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:51.521420 23710 raft_consensus.cc:2379] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 1: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:51.525871 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:51.527089 23710 raft_consensus.cc:2379] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 3: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:51.529760 24856 raft_consensus.cc:3037] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:51.530808 24719 consensus_queue.cc:1046] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:51.532081 24719 raft_consensus.cc:3032] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:51.532461 24719 raft_consensus.cc:729] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:51.533650 24719 consensus_queue.cc:260] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.529692 24742 raft_consensus.cc:686] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:51.548036 24719 raft_consensus.cc:3037] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:51.546871 24888 raft_consensus.cc:3037] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:51.551131 24853 consensus_queue.cc:1046] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:51.551965 24795 consensus_queue.cc:1046] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:51.552574 24853 consensus_queue.cc:1046] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:51.553229 24795 raft_consensus.cc:3032] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:40:51.553524 24853 consensus_queue.cc:1225] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer 8a3af1d071e74f2eb0c821e2bd68fe37 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260807 13:40:51.553647 24795 raft_consensus.cc:729] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:51.554260 24853 consensus_queue.cc:1046] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:51.555738 24651 raft_consensus.cc:3032] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:51.555861 24853 raft_consensus.cc:3032] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:51.556185 24651 raft_consensus.cc:729] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:51.556365 24853 raft_consensus.cc:729] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:51.557296 24651 consensus_queue.cc:260] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.557713 24853 consensus_queue.cc:260] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.554986 24833 raft_consensus.cc:3032] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:51.559298 24833 raft_consensus.cc:729] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:51.559397 24853 raft_consensus.cc:3037] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:51.560431 24833 consensus_queue.cc:260] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.561843 24833 raft_consensus.cc:3037] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:51.563073 24795 consensus_queue.cc:260] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.564561 24795 raft_consensus.cc:3037] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:51.565060 24856 raft_consensus.cc:2726] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:51.548820 24742 consensus_queue.cc:237] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.568790 24651 raft_consensus.cc:3037] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:40:51.573240 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 56933.3us
I20260807 13:40:51.574422 24856 consensus_queue.cc:1046] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260807 13:40:51.575513 23554 leader_election.cc:334] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Timed out: RequestConsensusVote RPC to 127.21.82.67:46685 timed out after 2.014s (SENT)
I20260807 13:40:51.576354 24739 raft_consensus.cc:3032] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:51.577105 24739 raft_consensus.cc:729] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:51.578351 24739 consensus_queue.cc:260] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.580077 24739 raft_consensus.cc:3037] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:51.583748 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:51.584765 23710 raft_consensus.cc:2379] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:51.585182 23448 catalog_manager.cc:5495] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 2 to 3, leader changed from d28e736aee9f4f01b013de670a762697 (127.21.82.67) to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 3 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:51.588093 23448 catalog_manager.cc:5495] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 1 to 2, leader changed from 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65) to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 2 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:51.590476 23448 catalog_manager.cc:5495] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 1 to 3, leader changed from 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65) to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 3 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:51.593014 23448 catalog_manager.cc:5495] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 1 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:51.594477 23710 raft_consensus.cc:1226] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:51.594877 23448 catalog_manager.cc:5495] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 2 to 3, leader changed from d28e736aee9f4f01b013de670a762697 (127.21.82.67) to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 3 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:51.598342 23448 catalog_manager.cc:5495] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 1 to 3, leader changed from 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65) to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 3 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:51.600214 23448 catalog_manager.cc:5495] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:51.602002 23448 catalog_manager.cc:5495] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 1 to 3, leader changed from 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65) to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 3 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:51.603936 23710 raft_consensus.cc:1226] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:51.604055 23448 catalog_manager.cc:5495] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 2 to 3, leader changed from 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65) to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 3 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:51.614495 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:51.610080 24888 raft_consensus.cc:2726] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:51.612841 23554 leader_election.cc:398] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Vote denied by peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685) with higher term. Message: Invalid argument: T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 2. Current term is 3.
I20260807 13:40:51.620446 23705 raft_consensus.cc:1226] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:51.619172 23554 leader_election.cc:401] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:40:51.631916 23554 leader_election.cc:302] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:51.633464 24853 raft_consensus.cc:3037] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:51.635926 23660 leader_election.cc:398] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Vote denied by peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685) with higher term. Message: Invalid argument: T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
I20260807 13:40:51.636313 23660 leader_election.cc:401] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260807 13:40:51.637383 24846 raft_consensus.cc:2726] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685) with higher term. Message: Invalid argument: T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
I20260807 13:40:51.633651 23554 leader_election.cc:302] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:51.643077 23554 leader_election.cc:302] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:51.643589 24846 consensus_queue.cc:1046] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:51.644574 23554 leader_election.cc:302] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:51.644765 24846 consensus_queue.cc:1046] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:51.645545 24842 raft_consensus.cc:3032] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:51.645745 24846 raft_consensus.cc:3032] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:51.645936 24842 raft_consensus.cc:729] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:51.646154 24846 raft_consensus.cc:729] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:51.646797 24795 raft_consensus.cc:3037] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:51.647141 24842 consensus_queue.cc:260] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.647480 24846 consensus_queue.cc:260] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.648519 24842 raft_consensus.cc:3037] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:51.648877 24846 raft_consensus.cc:3037] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:51.627043 24888 raft_consensus.cc:2726] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685) with higher term. Message: Invalid argument: T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 2. Current term is 3.
I20260807 13:40:51.650979 24856 raft_consensus.cc:2726] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:51.651262 24888 raft_consensus.cc:2781] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:51.662504 24888 raft_consensus.cc:686] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:51.652773 24832 consensus_queue.cc:1046] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.010s
W20260807 13:40:51.663242 23660 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.82.67:46685 timed out after 2.123s (SENT) [suppressed 83 similar messages]
I20260807 13:40:51.663599 24832 raft_consensus.cc:3032] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:51.664053 24832 raft_consensus.cc:729] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:51.665017 24832 consensus_queue.cc:260] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.667912 24834 consensus_queue.cc:1046] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:51.663623 24888 consensus_queue.cc:237] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.673246 23554 leader_election.cc:302] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:51.674459 23554 leader_election.cc:302] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:51.676095 24719 raft_consensus.cc:2781] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:51.678272 24781 raft_consensus.cc:3032] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:51.678712 24781 raft_consensus.cc:729] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:51.666446 24832 raft_consensus.cc:3037] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:51.682960 24719 raft_consensus.cc:686] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:51.688740 24719 consensus_queue.cc:237] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.691306 24834 consensus_queue.cc:1046] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:51.692939 24610 consensus_queue.cc:1046] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:51.693898 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:51.700940 24605 raft_consensus.cc:3032] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:51.701036 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:51.701442 24605 raft_consensus.cc:729] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:51.701835 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:51.702418 24605 consensus_queue.cc:260] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.703944 24605 raft_consensus.cc:3037] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:51.705542 24834 raft_consensus.cc:3032] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:51.705935 24834 raft_consensus.cc:729] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:51.706838 24834 consensus_queue.cc:260] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.694432 24739 raft_consensus.cc:2781] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:51.685699 24781 consensus_queue.cc:260] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.719257 24739 raft_consensus.cc:686] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:51.719723 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:51.720491 23703 raft_consensus.cc:3037] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:51.721805 24781 raft_consensus.cc:3037] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:51.725145 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:51.720503 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:51.729367 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:51.729789 23704 raft_consensus.cc:2379] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 2: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:51.733829 23703 raft_consensus.cc:2454] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:51.727044 24610 consensus_queue.cc:1046] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260807 13:40:51.734561 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:51.733968 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9552d42b445450691daef21fba4059a" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:51.735021 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:51.735634 23702 raft_consensus.cc:2379] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 1: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:51.735749 23700 raft_consensus.cc:2362] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3. Re-sending same reply.
I20260807 13:40:51.737025 24846 raft_consensus.cc:3032] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:51.737528 24846 raft_consensus.cc:729] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:51.737927 24795 raft_consensus.cc:2726] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:51.738147 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac6e18ecd14ba2a7d3e846a9fc81bf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:51.738881 23709 raft_consensus.cc:3037] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:51.738790 24846 consensus_queue.cc:260] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.730569 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:51.749524 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:51.720503 24739 consensus_queue.cc:237] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.750553 23704 raft_consensus.cc:2379] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:51.751859 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:51.752646 23700 raft_consensus.cc:3037] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:51.755327 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:51.759084 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:51.761550 24834 raft_consensus.cc:3037] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:51.764150 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:51.764813 23825 raft_consensus.cc:3037] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:51.765837 23705 raft_consensus.cc:2454] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:51.768826 23821 raft_consensus.cc:2454] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:51.777498 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:51.778102 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:51.780378 23703 raft_consensus.cc:2396] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 13:40:51.779058 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:51.778929 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:51.783183 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:51.785040 23703 raft_consensus.cc:2379] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 4: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:51.784628 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:51.789837 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:51.791637 23711 raft_consensus.cc:1226] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:51.793989 23699 raft_consensus.cc:2379] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 2: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:51.798267 24853 raft_consensus.cc:2726] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:51.800041 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:51.800958 23821 raft_consensus.cc:2379] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:51.806427 24583 consensus_queue.cc:1046] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:51.807160 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:51.808380 24800 raft_consensus.cc:3032] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:51.808773 24800 raft_consensus.cc:729] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:51.809047 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:51.809755 23818 raft_consensus.cc:2454] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:51.809832 24800 consensus_queue.cc:260] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.811616 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:51.811797 24800 raft_consensus.cc:3037] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:51.814936 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
W20260807 13:40:51.813177 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 105418us
I20260807 13:40:51.817643 23825 raft_consensus.cc:2454] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:40:51.820559 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:51.822839 23818 raft_consensus.cc:1261] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:51.825649 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:51.826936 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:51.826865 24872 consensus_queue.cc:1046] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:51.828084 24872 raft_consensus.cc:3032] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:51.828213 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:51.826231 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:51.828440 24872 raft_consensus.cc:729] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:51.829349 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:51.833148 24876 consensus_queue.cc:1046] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:51.835491 24745 raft_consensus.cc:3032] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:51.835958 24745 raft_consensus.cc:729] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:51.836182 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:51.837200 24745 consensus_queue.cc:260] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.838577 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:51.839561 23699 raft_consensus.cc:2379] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 2: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:51.839362 24872 consensus_queue.cc:260] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.817379 23709 raft_consensus.cc:2454] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:51.843995 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f8a5f186bf1473a988921e5efa3e574" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:51.845435 24834 consensus_queue.cc:1046] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:51.845745 24853 raft_consensus.cc:482] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:51.848546 24888 raft_consensus.cc:482] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:51.848637 24853 raft_consensus.cc:504] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.849155 24888 raft_consensus.cc:504] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.851234 24834 raft_consensus.cc:3032] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:51.851643 24834 raft_consensus.cc:729] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:51.852082 23700 raft_consensus.cc:2454] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:51.852824 24853 leader_election.cc:288] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:51.853426 23818 raft_consensus.cc:2379] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 1: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:51.853783 24834 consensus_queue.cc:260] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.853415 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:51.856344 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9552d42b445450691daef21fba4059a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:51.857429 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:51.841385 24872 raft_consensus.cc:3037] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:51.859110 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:51.852298 24846 raft_consensus.cc:3037] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:51.824033 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:51.856974 23820 raft_consensus.cc:2362] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1. Re-sending same reply.
I20260807 13:40:51.841461 24745 raft_consensus.cc:3037] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:51.866830 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:51.867266 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:51.867683 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:51.844682 24781 consensus_queue.cc:1046] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260807 13:40:51.872251 24888 leader_election.cc:288] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:51.873136 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:51.875502 23825 raft_consensus.cc:2379] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 3: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:51.879189 23821 raft_consensus.cc:2379] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 4: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:51.879680 23812 raft_consensus.cc:2354] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
I20260807 13:40:51.881435 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:51.887256 23704 raft_consensus.cc:2454] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:51.890877 23702 raft_consensus.cc:2379] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 2: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:51.893093 23588 raft_consensus.cc:1226] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 13:40:51.893201 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:51.877034 24853 raft_consensus.cc:482] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:51.897536 24853 raft_consensus.cc:504] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.899359 24781 raft_consensus.cc:3032] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:51.899760 24781 raft_consensus.cc:729] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:51.900686 24781 consensus_queue.cc:260] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:51.901947 24781 raft_consensus.cc:3037] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:51.903837 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:51.904698 23588 raft_consensus.cc:2379] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:51.905629 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:51.909845 23595 raft_consensus.cc:2454] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:51.910712 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:51.912417 23588 raft_consensus.cc:1261] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:51.916599 23823 raft_consensus.cc:2454] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:51.915309 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:51.918912 23815 raft_consensus.cc:1261] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:51.920956 23821 raft_consensus.cc:1261] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:51.921774 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:51.920398 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:51.923112 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:51.923761 24834 raft_consensus.cc:3037] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:51.924701 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:51.929394 23600 raft_consensus.cc:2379] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:51.935077 23818 raft_consensus.cc:1261] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:51.939344 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:51.940328 23600 raft_consensus.cc:2396] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 13:40:51.941640 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:51.942203 23600 raft_consensus.cc:3037] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:51.943238 23817 raft_consensus.cc:2454] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:51.951886 23599 raft_consensus.cc:2454] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:51.961901 23818 raft_consensus.cc:1261] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:51.965008 23709 raft_consensus.cc:3037] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:51.964990 23812 raft_consensus.cc:1261] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260807 13:40:51.967713 23812 pending_rounds.cc:76] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697: Aborting all ops after (but not including) 1
I20260807 13:40:51.967995 23812 pending_rounds.cc:97] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260807 13:40:51.968067 23825 raft_consensus.cc:1261] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260807 13:40:51.968465 23825 pending_rounds.cc:76] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697: Aborting all ops after (but not including) 1
I20260807 13:40:51.968766 23825 pending_rounds.cc:97] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260807 13:40:51.969046 23825 raft_consensus.cc:2866] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:40:51.968319 23812 raft_consensus.cc:2866] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:40:51.971745 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:51.972673 23588 raft_consensus.cc:2379] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:51.975971 23554 leader_election.cc:302] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:51.976912 23554 leader_election.cc:302] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:51.977437 23821 raft_consensus.cc:1261] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:51.977658 24888 raft_consensus.cc:2781] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:51.978196 23554 leader_election.cc:302] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:51.964984 23704 raft_consensus.cc:1261] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:51.978837 24739 raft_consensus.cc:2726] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:40:51.971799 23660 leader_election.cc:302] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:51.978309 24888 raft_consensus.cc:686] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:51.974495 23815 raft_consensus.cc:1261] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:51.980252 24888 consensus_queue.cc:237] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:51.982815 23535 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:40:51.984000 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:51.984638 23704 raft_consensus.cc:1261] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:51.970436 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:51.985813 23595 raft_consensus.cc:2379] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:51.984783 23823 raft_consensus.cc:2379] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:51.991047 23590 raft_consensus.cc:2454] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:51.989959 23600 raft_consensus.cc:2454] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:51.995041 23554 leader_election.cc:302] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:51.997788 23660 leader_election.cc:302] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:51.998582 24846 raft_consensus.cc:3037] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:51.998823 24905 raft_consensus.cc:2781] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:40:51.999459 24905 raft_consensus.cc:686] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:52.000375 23660 leader_election.cc:398] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Vote denied by peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685) with higher term. Message: Invalid argument: T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
I20260807 13:40:52.001533 23660 leader_election.cc:401] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260807 13:40:52.002277 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f8a5f186bf1473a988921e5efa3e574" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.002787 23599 raft_consensus.cc:3037] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:40:52.000365 24905 consensus_queue.cc:237] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:52.003897 24605 raft_consensus.cc:2726] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685) with higher term. Message: Invalid argument: T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
I20260807 13:40:52.004973 23660 leader_election.cc:302] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:52.006436 24605 raft_consensus.cc:2781] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:52.006944 24605 raft_consensus.cc:686] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:52.008123 24739 raft_consensus.cc:2781] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:40:52.011737 23600 raft_consensus.cc:1226] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:52.007773 24605 consensus_queue.cc:237] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:52.008492 24795 consensus_queue.cc:1035] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260807 13:40:52.005295 24719 raft_consensus.cc:2781] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:40:52.014128 24739 raft_consensus.cc:686] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:52.016896 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:52.017170 24719 raft_consensus.cc:482] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:52.018067 24853 leader_election.cc:288] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:52.018294 24719 raft_consensus.cc:3037] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:52.017988 24739 consensus_queue.cc:237] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:52.017932 23590 raft_consensus.cc:2379] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 3: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:52.027206 23599 raft_consensus.cc:2454] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:52.028201 24832 consensus_queue.cc:1035] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:52.030165 23769 leader_election.cc:302] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:52.031072 24745 raft_consensus.cc:3037] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:52.035548 24610 consensus_queue.cc:1035] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:52.035050 24781 consensus_queue.cc:1035] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260807 13:40:52.038990 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.043882 23600 raft_consensus.cc:2379] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:52.044404 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.045508 23590 raft_consensus.cc:2396] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260807 13:40:52.045327 24800 consensus_queue.cc:1046] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:52.040735 24719 raft_consensus.cc:504] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:52.041399 24872 consensus_queue.cc:1046] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:52.047851 24799 raft_consensus.cc:3032] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:52.048213 24872 raft_consensus.cc:3032] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:52.048270 24799 raft_consensus.cc:729] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:52.050947 24800 consensus_queue.cc:1046] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:52.051849 24719 leader_election.cc:288] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:52.051414 24799 consensus_queue.cc:260] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:52.055362 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:52.051940 24800 raft_consensus.cc:3032] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:52.049173 24872 raft_consensus.cc:729] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:52.058365 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "830e8cb8ce434e6391c09530c677a61d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:52.052806 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.054872 24799 raft_consensus.cc:3037] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:52.056682 23599 raft_consensus.cc:2396] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:40:52.061767 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.056900 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9552d42b445450691daef21fba4059a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.052964 24745 raft_consensus.cc:2726] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:52.059952 24872 consensus_queue.cc:260] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:52.064585 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.065555 24872 raft_consensus.cc:3037] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:52.065701 23594 raft_consensus.cc:2362] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3. Re-sending same reply.
I20260807 13:40:52.056964 24800 raft_consensus.cc:729] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:52.066304 23588 raft_consensus.cc:2379] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 1: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:52.060470 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.067216 24583 raft_consensus.cc:482] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:52.066905 24800 consensus_queue.cc:260] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:52.067695 24583 raft_consensus.cc:504] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:52.068192 24800 raft_consensus.cc:3037] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:52.069722 24583 leader_election.cc:288] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:52.063046 23595 raft_consensus.cc:2362] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1. Re-sending same reply.
I20260807 13:40:52.063138 23590 raft_consensus.cc:3037] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:52.063582 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:52.071282 23598 raft_consensus.cc:2454] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:52.064565 23601 raft_consensus.cc:1261] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:52.062670 24876 consensus_queue.cc:1035] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260807 13:40:52.063288 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.074079 23599 raft_consensus.cc:2396] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:40:52.078604 24605 raft_consensus.cc:482] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:52.079285 24605 raft_consensus.cc:504] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:52.082562 24605 leader_election.cc:288] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:52.085337 24859 consensus_queue.cc:1035] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:52.086427 24858 consensus_queue.cc:1035] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:52.087126 23599 raft_consensus.cc:1261] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:52.087852 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f8a5f186bf1473a988921e5efa3e574" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:52.088037 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "830e8cb8ce434e6391c09530c677a61d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:52.088690 23815 raft_consensus.cc:2379] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 1: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:52.088446 24605 consensus_queue.cc:1035] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:52.085505 24876 consensus_queue.cc:1035] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:52.091138 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:52.091814 23821 raft_consensus.cc:3037] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:52.094065 24605 consensus_queue.cc:1035] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:52.096159 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:52.096900 23823 raft_consensus.cc:2454] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:52.096979 24605 consensus_queue.cc:1035] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:52.088267 24846 raft_consensus.cc:2726] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:52.101202 24846 consensus_queue.cc:1035] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:52.102890 23660 leader_election.cc:302] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:52.103883 24905 raft_consensus.cc:2781] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:52.104792 24905 raft_consensus.cc:686] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:52.105836 24905 consensus_queue.cc:237] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:52.106567 24605 consensus_queue.cc:1035] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:52.110229 23821 raft_consensus.cc:2454] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:40:52.111518 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:52.111964 23710 raft_consensus.cc:1261] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:52.112524 23591 raft_consensus.cc:2454] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:52.113857 23601 raft_consensus.cc:1261] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260807 13:40:52.101169 23709 raft_consensus.cc:1261] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:52.122267 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:52.130745 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:52.139127 23601 pending_rounds.cc:76] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812: Aborting all ops after (but not including) 1
I20260807 13:40:52.143117 23601 pending_rounds.cc:97] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260807 13:40:52.143419 23601 raft_consensus.cc:2866] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:40:52.147786 23599 raft_consensus.cc:2379] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 3: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:52.149008 23817 raft_consensus.cc:2454] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:52.154940 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.155171 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.155625 23704 raft_consensus.cc:2454] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:52.170140 23599 raft_consensus.cc:1261] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:52.170435 23554 leader_election.cc:302] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:52.173064 23598 raft_consensus.cc:1261] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:52.175045 23554 leader_election.cc:302] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:52.179769 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:52.171442 23815 raft_consensus.cc:1226] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:40:52.181201 23599 raft_consensus.cc:2379] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:52.172260 24719 raft_consensus.cc:2741] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260807 13:40:52.173868 23588 raft_consensus.cc:1261] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:52.176654 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:52.184161 23769 leader_election.cc:302] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:52.181767 24853 raft_consensus.cc:2781] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:40:52.192710 23660 leader_election.cc:302] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:52.196686 24858 raft_consensus.cc:2781] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:52.197109 24858 raft_consensus.cc:482] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:52.197050 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4062e0223a4cc0b2e448e35445671d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.197594 24858 raft_consensus.cc:3037] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:52.190584 23590 raft_consensus.cc:2454] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:52.210042 24846 raft_consensus.cc:2781] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:52.219063 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.227494 23598 raft_consensus.cc:2396] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 13:40:52.208015 24853 raft_consensus.cc:686] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:52.231611 23588 raft_consensus.cc:2454] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:52.187875 24800 consensus_queue.cc:1035] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260807 13:40:52.201511 24745 consensus_queue.cc:1035] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260807 13:40:52.229926 23595 raft_consensus.cc:1261] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:52.230500 23591 raft_consensus.cc:1226] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:52.231492 24853 consensus_queue.cc:237] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:52.210494 24846 raft_consensus.cc:482] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:52.237699 23600 raft_consensus.cc:1226] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:52.238806 23597 raft_consensus.cc:2454] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:52.256088 23599 raft_consensus.cc:1226] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:52.262799 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.255949 23447 catalog_manager.cc:5495] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 1 to 3, leader changed from 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66) to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 3 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:52.270877 23447 catalog_manager.cc:5495] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 1 to 3, leader changed from 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65) to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 3 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:52.277266 23447 catalog_manager.cc:5495] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 0 to 1, leader changed from <none> to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 1 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:52.279578 23447 catalog_manager.cc:5495] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 2 to 3, leader changed from 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65) to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 3 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:52.254037 24846 raft_consensus.cc:3037] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:52.282364 23447 catalog_manager.cc:5495] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 1 to 3, leader changed from 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65) to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 3 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:52.284231 24748 raft_consensus.cc:482] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:52.289357 23597 raft_consensus.cc:1226] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:52.253517 24781 consensus_queue.cc:1046] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
W20260807 13:40:52.294124 24918 log.cc:924] Time spent T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.061s user 0.001s sys 0.000s
I20260807 13:40:52.308079 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.318037 23599 raft_consensus.cc:2379] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 3: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:52.323662 24858 raft_consensus.cc:504] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:52.326869 23820 raft_consensus.cc:1226] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:52.329499 24800 raft_consensus.cc:482] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:52.330020 24800 raft_consensus.cc:504] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:52.331020 23588 raft_consensus.cc:1226] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:52.331187 23600 raft_consensus.cc:1226] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:52.332129 24800 leader_election.cc:288] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:52.333010 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.333616 24858 leader_election.cc:288] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:52.333976 23590 raft_consensus.cc:2396] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:40:52.359593 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:52.360478 23711 raft_consensus.cc:3037] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:52.292459 24748 raft_consensus.cc:504] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:52.389433 23597 raft_consensus.cc:1226] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:52.394141 23600 raft_consensus.cc:1226] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:52.394534 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f8a5f186bf1473a988921e5efa3e574" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.399899 23598 raft_consensus.cc:2379] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 1: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:52.394985 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.395329 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.394223 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
W20260807 13:40:52.397146 24928 log.cc:924] Time spent T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.050s user 0.000s sys 0.000s
I20260807 13:40:52.324088 23815 raft_consensus.cc:1261] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260807 13:40:52.398085 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 98187.5us
I20260807 13:40:52.405345 23601 raft_consensus.cc:2379] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:52.404958 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.407619 23598 raft_consensus.cc:3037] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:52.408335 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.412015 23600 raft_consensus.cc:2379] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:52.402468 24799 raft_consensus.cc:482] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:52.419091 23594 raft_consensus.cc:2379] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
W20260807 13:40:52.419636 24922 log.cc:924] Time spent T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.102s user 0.001s sys 0.000s
I20260807 13:40:52.420902 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.421280 24748 leader_election.cc:288] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:52.422084 23594 raft_consensus.cc:2396] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 13:40:52.422946 23588 raft_consensus.cc:2379] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:52.419145 23814 raft_consensus.cc:1261] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:52.400481 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:52.424507 23595 raft_consensus.cc:1226] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:52.409343 23591 raft_consensus.cc:1226] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:52.415508 23590 raft_consensus.cc:1226] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:52.428190 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:52.433058 24846 raft_consensus.cc:504] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:52.436967 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:52.468868 23600 raft_consensus.cc:2454] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:52.471678 23711 raft_consensus.cc:2454] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:52.475867 23699 raft_consensus.cc:2454] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:52.474822 24719 consensus_queue.cc:1035] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.002s
I20260807 13:40:52.478044 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:52.478477 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.479115 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:52.479498 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9552d42b445450691daef21fba4059a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:52.480273 23594 raft_consensus.cc:2379] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 1: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:52.480310 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.481134 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.481649 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4062e0223a4cc0b2e448e35445671d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.482200 23597 raft_consensus.cc:2362] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1. Re-sending same reply.
I20260807 13:40:52.483150 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.483505 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.483704 23813 raft_consensus.cc:1261] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:52.483969 23597 raft_consensus.cc:2396] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 13:40:52.484772 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.485531 23597 raft_consensus.cc:2396] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:40:52.486233 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:52.488090 23597 raft_consensus.cc:2454] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:52.481187 23601 raft_consensus.cc:2396] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:40:52.489219 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.489986 23601 raft_consensus.cc:2396] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260807 13:40:52.490726 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:52.491415 23601 raft_consensus.cc:2379] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 3: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:52.495514 23598 raft_consensus.cc:2454] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
W20260807 13:40:52.496555 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 44844.6us
I20260807 13:40:52.482301 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.512354 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:52.513161 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:52.512171 23772 leader_election.cc:334] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Timed out: RequestConsensusVote RPC to 127.21.82.65:33187 timed out after 1.942s (SENT)
I20260807 13:40:52.514876 23598 raft_consensus.cc:1261] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260807 13:40:52.438124 24799 raft_consensus.cc:504] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:52.518042 23594 raft_consensus.cc:2396] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:40:52.515360 23598 pending_rounds.cc:76] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812: Aborting all ops after (but not including) 1
I20260807 13:40:52.526316 23598 pending_rounds.cc:97] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260807 13:40:52.527262 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.528041 23600 raft_consensus.cc:3037] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:52.463059 24739 consensus_queue.cc:1046] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.046s
I20260807 13:40:52.526628 23598 raft_consensus.cc:2866] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:40:52.569401 23600 raft_consensus.cc:2454] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:52.572501 23594 raft_consensus.cc:1226] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:52.573645 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.586150 23598 raft_consensus.cc:2379] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 3: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
W20260807 13:40:52.590214 23772 leader_election.cc:334] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: RPC error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Timed out: RequestConsensusVote RPC to 127.21.82.65:33187 timed out after 1.541s (SENT)
I20260807 13:40:52.591235 23588 raft_consensus.cc:2454] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:52.594089 23590 raft_consensus.cc:2454] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:52.594805 23595 raft_consensus.cc:1261] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260807 13:40:52.595184 23595 pending_rounds.cc:76] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812: Aborting all ops after (but not including) 1
I20260807 13:40:52.595463 23595 pending_rounds.cc:97] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260807 13:40:52.595719 23595 raft_consensus.cc:2866] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:40:52.555202 23815 raft_consensus.cc:1261] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:52.592428 23600 raft_consensus.cc:1261] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:52.598781 24846 leader_election.cc:288] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:52.598781 24799 leader_election.cc:288] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:40:52.609030 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 111595us
I20260807 13:40:52.611756 23769 leader_election.cc:302] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:52.612952 23769 leader_election.cc:302] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:52.615281 24799 raft_consensus.cc:2781] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:52.615865 24799 raft_consensus.cc:686] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
W20260807 13:40:52.615900 23662 leader_election.cc:334] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: RPC error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Timed out: RequestConsensusVote RPC to 127.21.82.65:33187 timed out after 1.764s (SENT)
I20260807 13:40:52.616922 24799 consensus_queue.cc:237] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:52.618433 24932 log.cc:924] Time spent T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.093s user 0.001s sys 0.000s
I20260807 13:40:52.619571 23590 raft_consensus.cc:1226] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:52.640311 24799 raft_consensus.cc:2781] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:40:52.642855 24799 raft_consensus.cc:482] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:52.643249 24799 raft_consensus.cc:3037] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:52.643942 24605 raft_consensus.cc:3032] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:40:52.644337 24605 raft_consensus.cc:729] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:52.645203 24605 consensus_queue.cc:260] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:52.646313 24605 raft_consensus.cc:3037] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:52.647063 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.647816 23594 raft_consensus.cc:2379] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:52.639635 24719 raft_consensus.cc:3032] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:52.651355 24719 raft_consensus.cc:729] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:52.652606 23594 raft_consensus.cc:1226] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:52.652245 24719 consensus_queue.cc:260] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:52.653209 24719 raft_consensus.cc:3037] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:52.655324 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:52.655756 23595 raft_consensus.cc:1261] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:52.658296 23600 raft_consensus.cc:1226] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:52.657243 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.670217 23588 raft_consensus.cc:2379] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:52.683626 24795 consensus_queue.cc:1035] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:52.687661 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:52.688705 23710 raft_consensus.cc:2454] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:52.674975 24858 raft_consensus.cc:482] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:52.692487 24858 raft_consensus.cc:504] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:52.695147 23447 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37968 (request call id 127) took 1133 ms. Trace:
I20260807 13:40:52.695407 23815 raft_consensus.cc:1226] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:52.697268 23825 raft_consensus.cc:1261] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:40:52.700165 24739 raft_consensus.cc:482] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:52.700843 24739 raft_consensus.cc:504] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:52.703673 23772 leader_election.cc:334] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Timed out: RequestConsensusVote RPC to 127.21.82.65:33187 timed out after 1.819s (SENT)
I20260807 13:40:52.704339 23772 leader_election.cc:302] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
W20260807 13:40:52.708253 24961 log.cc:924] Time spent T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.070s user 0.001s sys 0.000s
I20260807 13:40:52.709074 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f8a5f186bf1473a988921e5efa3e574" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.710193 23595 raft_consensus.cc:2379] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 1: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:52.710242 24651 consensus_queue.cc:1035] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:40:52.718101 23449 catalog_manager.cc:5495] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 2 to 3, leader changed from 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66) to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 3 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:52.723889 23449 catalog_manager.cc:5495] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 1 to 2, leader changed from d28e736aee9f4f01b013de670a762697 (127.21.82.67) to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 2 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:52.695762 23447 rpcz_store.cc:276] 0807 13:40:51.561377 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:51.561569 (+ 192us) service_pool.cc:227] Handling call
0807 13:40:52.695033 (+1133464us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:40:52.313819 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:40:52.314408 (+ 589us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:40:52.314451 (+ 43us) write_op.cc:435] Acquired schema lock
0807 13:40:52.314472 (+ 21us) tablet.cc:660] Decoding operations
0807 13:40:52.315195 (+ 723us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:40:52.315256 (+ 61us) write_op.cc:641] Partition lock acquired for write op
0807 13:40:52.315283 (+ 27us) tablet.cc:683] Acquiring locks for 5 operations
0807 13:40:52.315801 (+ 518us) tablet.cc:699] Row locks acquired
0807 13:40:52.315816 (+ 15us) write_op.cc:260] PREPARE: finished
0807 13:40:52.315971 (+ 155us) write_op.cc:270] Start()
0807 13:40:52.316090 (+ 119us) write_op.cc:276] Timestamp: P: 1786110052315929 usec, L: 0
0807 13:40:52.316107 (+ 17us) op_driver.cc:331] REPLICATION: starting
0807 13:40:52.398778 (+ 82671us) log.cc:842] Serialized 2074 byte log entry
0807 13:40:52.469397 (+ 70619us) op_driver.cc:444] REPLICATION: finished
0807 13:40:52.484660 (+ 15263us) write_op.cc:301] APPLY: starting
0807 13:40:52.484738 (+ 78us) tablet.cc:1365] starting BulkCheckPresence
0807 13:40:52.484911 (+ 173us) tablet.cc:1368] finished BulkCheckPresence
0807 13:40:52.485003 (+ 92us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:40:52.485567 (+ 564us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:40:52.485740 (+ 173us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0807 13:40:52.485782 (+ 42us) write_op.cc:312] APPLY: finished
0807 13:40:52.486020 (+ 238us) log.cc:842] Serialized 46 byte log entry
0807 13:40:52.486174 (+ 154us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:40:52.486289 (+ 115us) write_op.cc:454] Released schema lock
0807 13:40:52.486329 (+ 40us) write_op.cc:341] FINISH: Updating metrics
0807 13:40:52.486554 (+ 225us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:40:52.486581 (+ 27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1343,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":11401,"apply.run_cpu_time_us":2238,"apply.run_wall_time_us":2239,"num_ops":5,"prepare.queue_time_us":113,"prepare.run_cpu_time_us":3878,"prepare.run_wall_time_us":90417,"replication_time_us":147730}]]}
I20260807 13:40:52.726112 23449 catalog_manager.cc:5495] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:52.734109 24739 leader_election.cc:288] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:52.735285 24858 leader_election.cc:288] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:40:52.742349 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 294937us
I20260807 13:40:52.749358 23449 catalog_manager.cc:5495] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:52.751789 23449 catalog_manager.cc:5495] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 1 to 2, leader changed from d28e736aee9f4f01b013de670a762697 (127.21.82.67) to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 2 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:52.756456 23449 catalog_manager.cc:5495] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
W20260807 13:40:52.773569 24962 log.cc:924] Time spent T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.161s user 0.000s sys 0.001s
I20260807 13:40:52.774114 23449 catalog_manager.cc:5495] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 1 to 2, leader changed from d28e736aee9f4f01b013de670a762697 (127.21.82.67) to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 2 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
W20260807 13:40:52.787099 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 83477.9us
I20260807 13:40:52.800539 23447 catalog_manager.cc:5495] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 1 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:52.803139 23595 raft_consensus.cc:1226] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:52.754626 24905 consensus_queue.cc:1035] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260807 13:40:52.804699 23447 catalog_manager.cc:5495] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 1 to 2, leader changed from d28e736aee9f4f01b013de670a762697 (127.21.82.67) to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 2 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:52.682197 24853 consensus_queue.cc:1035] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
I20260807 13:40:52.811671 23591 raft_consensus.cc:1226] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:52.812979 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.813827 23588 raft_consensus.cc:2379] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:52.814539 23709 raft_consensus.cc:1226] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:52.814966 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.814893 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:52.815771 23600 raft_consensus.cc:2379] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:52.815879 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "830e8cb8ce434e6391c09530c677a61d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:52.815779 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:52.817013 23598 raft_consensus.cc:2454] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:52.817967 23447 catalog_manager.cc:5495] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 1 to 2, leader changed from d28e736aee9f4f01b013de670a762697 (127.21.82.67) to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 2 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:52.822269 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:52.823307 23702 raft_consensus.cc:2379] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
W20260807 13:40:52.824553 23662 leader_election.cc:334] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Timed out: RequestConsensusVote RPC to 127.21.82.65:33187 timed out after 1.687s (SENT)
I20260807 13:40:52.824721 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:52.825044 23662 leader_election.cc:302] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:52.821292 23447 catalog_manager.cc:5495] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 1 to 3, leader changed from 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65) to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 3 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:52.829022 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:52.820845 24853 raft_consensus.cc:482] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:52.854686 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
W20260807 13:40:52.856437 23662 leader_election.cc:334] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Timed out: RequestConsensusVote RPC to 127.21.82.65:33187 timed out after 1.702s (SENT)
I20260807 13:40:52.856874 23662 leader_election.cc:302] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:52.858052 24748 raft_consensus.cc:2726] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:40:52.858323 24965 raft_consensus.cc:482] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:52.843544 24905 raft_consensus.cc:2726] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:40:52.843780 24858 raft_consensus.cc:2726] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:40:52.859174 23591 raft_consensus.cc:2396] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 13:40:52.849876 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f8a5f186bf1473a988921e5efa3e574" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:52.858068 23662 leader_election.cc:334] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Timed out: RequestConsensusVote RPC to 127.21.82.65:33187 timed out after 1.876s (SENT)
I20260807 13:40:52.846705 24853 raft_consensus.cc:504] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:52.833474 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:52.869086 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 155329us
I20260807 13:40:52.883074 23662 leader_election.cc:302] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:52.884325 24905 raft_consensus.cc:2726] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:52.899288 24799 raft_consensus.cc:504] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:52.863263 24965 raft_consensus.cc:504] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:52.902319 24799 leader_election.cc:288] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:52.903885 24965 leader_election.cc:288] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:52.904538 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:52.914288 23702 raft_consensus.cc:2396] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:40:52.914871 23710 raft_consensus.cc:2454] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
W20260807 13:40:52.905085 24970 log.cc:924] Time spent T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.053s user 0.000s sys 0.001s
I20260807 13:40:52.908188 23709 raft_consensus.cc:2379] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 1: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:52.909914 23590 raft_consensus.cc:2454] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:52.913298 24853 leader_election.cc:288] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:52.929112 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 71095.1us
I20260807 13:40:52.937975 23814 raft_consensus.cc:1226] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:40:52.940809 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:52.942667 23823 raft_consensus.cc:3037] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:52.954692 23769 leader_election.cc:302] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:52.956357 23710 raft_consensus.cc:1261] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:52.942716 24799 raft_consensus.cc:482] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:52.959587 23702 raft_consensus.cc:1261] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260807 13:40:52.962051 23702 pending_rounds.cc:76] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37: Aborting all ops after (but not including) 1
I20260807 13:40:52.962301 23702 pending_rounds.cc:97] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260807 13:40:52.962548 23702 raft_consensus.cc:2866] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:40:52.965155 23710 raft_consensus.cc:3037] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:52.968505 23823 raft_consensus.cc:2454] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:52.969467 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:52.969620 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:52.970192 23813 raft_consensus.cc:2454] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:52.970435 23823 raft_consensus.cc:2454] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:52.971163 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:52.975013 23820 raft_consensus.cc:1261] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260807 13:40:52.977627 24859 raft_consensus.cc:2781] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:52.977999 24859 raft_consensus.cc:482] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:52.978319 24859 raft_consensus.cc:3037] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:52.981475 23817 raft_consensus.cc:1261] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:52.981240 24876 consensus_queue.cc:1046] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:40:52.982188 24858 consensus_queue.cc:1046] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:40:52.983415 24858 raft_consensus.cc:3032] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:52.983776 24858 raft_consensus.cc:729] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:52.984674 24872 consensus_queue.cc:1046] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:40:52.984567 24858 consensus_queue.cc:260] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:52.974406 23595 raft_consensus.cc:2454] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:52.986951 24860 raft_consensus.cc:3032] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:52.987092 24876 raft_consensus.cc:3032] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:52.987358 24860 raft_consensus.cc:729] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:52.987461 24876 raft_consensus.cc:729] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:52.987739 23702 raft_consensus.cc:1261] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260807 13:40:52.988091 23702 pending_rounds.cc:76] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37: Aborting all ops after (but not including) 1
I20260807 13:40:52.988303 23702 pending_rounds.cc:97] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260807 13:40:52.988735 23702 raft_consensus.cc:2866] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:40:52.988215 24860 consensus_queue.cc:260] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:52.988236 24876 consensus_queue.cc:260] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:52.989411 24860 raft_consensus.cc:3037] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:52.990224 24876 raft_consensus.cc:3037] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:52.991760 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:53.003605 23662 leader_election.cc:302] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:53.003300 23702 raft_consensus.cc:2454] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:53.009850 24905 raft_consensus.cc:482] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:53.010900 23709 raft_consensus.cc:1261] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:53.010551 24905 raft_consensus.cc:504] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.011655 24583 raft_consensus.cc:482] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:53.010226 23772 leader_election.cc:302] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:53.012020 24853 raft_consensus.cc:482] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:53.012270 24583 raft_consensus.cc:504] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.013289 23772 leader_election.cc:302] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:53.015147 24977 raft_consensus.cc:2726] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:40:53.015259 24979 raft_consensus.cc:2726] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:53.012979 24853 raft_consensus.cc:504] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.015944 24905 leader_election.cc:288] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:53.016662 24905 raft_consensus.cc:2726] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:40:53.021389 23772 leader_election.cc:302] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:53.018476 24853 leader_election.cc:288] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:53.024258 24745 raft_consensus.cc:2726] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:53.025230 23662 leader_election.cc:302] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:52.964696 24799 raft_consensus.cc:504] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
I20260807 13:40:53.025812 23704 raft_consensus.cc:1261] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:53.033339 24859 raft_consensus.cc:504] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.032013 24781 raft_consensus.cc:2726] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:53.036671 24719 raft_consensus.cc:482] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:53.037834 24739 raft_consensus.cc:482] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:53.038041 23555 leader_election.cc:302] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:53.038203 24719 raft_consensus.cc:504] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
I20260807 13:40:53.038625 24739 raft_consensus.cc:504] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.039557 23555 leader_election.cc:302] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:53.040242 24795 raft_consensus.cc:482] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:53.040658 23555 leader_election.cc:302] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:53.038707 24583 leader_election.cc:288] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:53.041338 23710 raft_consensus.cc:1261] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:40:53.043431 24651 raft_consensus.cc:2726] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:53.040735 24795 raft_consensus.cc:504] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.050451 24888 raft_consensus.cc:2726] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260807 13:40:53.057564 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 82602.7us
I20260807 13:40:53.045291 23447 catalog_manager.cc:5495] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 3 to 4, leader changed from 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66) to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 4 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:53.046054 24853 raft_consensus.cc:2726] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:53.069703 23447 catalog_manager.cc:5495] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 1 to 2, leader changed from d28e736aee9f4f01b013de670a762697 (127.21.82.67) to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 2 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:53.050508 24739 leader_election.cc:288] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:53.073203 23662 leader_election.cc:302] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:53.073766 23555 leader_election.cc:302] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:53.074162 23447 catalog_manager.cc:5495] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 2 to 4, leader changed from d28e736aee9f4f01b013de670a762697 (127.21.82.67) to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 4 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:53.056486 24719 leader_election.cc:288] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:53.076970 24739 raft_consensus.cc:2726] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:53.076678 24905 consensus_queue.cc:1035] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:53.079945 24965 raft_consensus.cc:3037] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:53.081334 24795 leader_election.cc:288] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:53.082160 23555 leader_election.cc:302] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:53.082950 24853 raft_consensus.cc:482] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:53.084774 23769 leader_election.cc:302] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:53.087819 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:53.089244 23710 raft_consensus.cc:3037] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:53.091593 23554 leader_election.cc:302] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:53.093360 23772 leader_election.cc:302] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:53.097915 24888 raft_consensus.cc:2781] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:53.072961 24781 consensus_queue.cc:1035] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260807 13:40:53.098542 24888 raft_consensus.cc:482] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:53.099140 24888 raft_consensus.cc:3037] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:53.102643 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:53.103430 23700 raft_consensus.cc:2454] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:53.104127 23772 leader_election.cc:302] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:53.105351 23772 leader_election.cc:302] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:53.105948 24982 raft_consensus.cc:2726] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:40:53.106612 24982 raft_consensus.cc:2741] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260807 13:40:53.107024 24956 raft_consensus.cc:2726] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:53.107112 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:53.107823 23700 raft_consensus.cc:2454] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:53.097121 23660 leader_election.cc:302] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:53.108362 23772 leader_election.cc:302] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:53.109015 23660 leader_election.cc:302] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:53.109202 24745 consensus_queue.cc:1046] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:53.110123 24937 raft_consensus.cc:2781] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:53.110357 24745 raft_consensus.cc:2726] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:53.110621 24937 raft_consensus.cc:686] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:53.111049 24745 raft_consensus.cc:3032] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:53.111399 24745 raft_consensus.cc:729] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:53.111941 24610 consensus_queue.cc:1035] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:53.111616 24937 consensus_queue.cc:237] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.113492 23555 leader_election.cc:302] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:53.116261 24982 raft_consensus.cc:482] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:53.117084 23555 leader_election.cc:302] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:53.116808 24982 raft_consensus.cc:504] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.118108 23710 raft_consensus.cc:2454] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 4.
I20260807 13:40:53.116304 24651 raft_consensus.cc:2726] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:53.119369 24651 raft_consensus.cc:2726] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:53.090327 24872 raft_consensus.cc:2781] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:40:53.120482 24872 raft_consensus.cc:482] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:53.120818 24872 raft_consensus.cc:3037] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:53.121201 24719 raft_consensus.cc:482] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:53.121658 24719 raft_consensus.cc:504] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.122112 24888 raft_consensus.cc:504] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.095965 24795 raft_consensus.cc:2726] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:53.114701 24739 consensus_queue.cc:1035] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260807 13:40:53.112948 24605 consensus_queue.cc:1035] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260807 13:40:53.119412 24982 leader_election.cc:288] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:53.110394 24748 raft_consensus.cc:2781] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:53.124984 24888 leader_election.cc:288] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:53.125121 24748 raft_consensus.cc:482] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:53.125568 24748 raft_consensus.cc:3037] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:53.127349 24719 leader_election.cc:288] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:53.128955 24982 raft_consensus.cc:482] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:53.129537 24982 raft_consensus.cc:504] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.131840 24982 leader_election.cc:288] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:53.135885 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:53.136405 23825 raft_consensus.cc:1226] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:53.136538 23821 raft_consensus.cc:2454] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:53.137698 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:53.138417 23821 raft_consensus.cc:2454] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:53.138864 23825 raft_consensus.cc:1226] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 2. Current term is 3. Ops: []
W20260807 13:40:53.139293 24991 log.cc:924] Time spent T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.055s user 0.001s sys 0.000s
I20260807 13:40:53.141027 23825 raft_consensus.cc:1261] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:53.142992 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9552d42b445450691daef21fba4059a" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:53.142328 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:53.143915 23818 raft_consensus.cc:2454] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:53.143076 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:53.146420 23825 raft_consensus.cc:2396] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:40:53.148357 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:53.150218 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:53.151890 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac6e18ecd14ba2a7d3e846a9fc81bf" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:53.152487 23702 raft_consensus.cc:2454] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:53.153126 23554 leader_election.cc:302] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:53.153545 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:53.153199 23662 leader_election.cc:302] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:53.154258 23710 raft_consensus.cc:3037] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:53.155159 23818 raft_consensus.cc:2454] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:53.096398 24799 leader_election.cc:288] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187)
I20260807 13:40:53.159504 24739 consensus_queue.cc:1046] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:53.159543 24605 raft_consensus.cc:482] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:53.155273 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:53.161527 23814 raft_consensus.cc:3037] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:53.160995 24605 raft_consensus.cc:504] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.162245 24858 raft_consensus.cc:3037] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:53.160336 24795 raft_consensus.cc:2781] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:40:53.170769 23769 leader_election.cc:302] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:53.112248 24745 consensus_queue.cc:260] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.172669 23660 leader_election.cc:302] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
W20260807 13:40:53.173187 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 64929.8us
W20260807 13:40:53.173599 23535 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:40:53.145162 24859 leader_election.cc:288] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:53.174671 23554 leader_election.cc:302] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
W20260807 13:40:53.177361 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 60343.8us
I20260807 13:40:53.114889 24853 raft_consensus.cc:504] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.181504 23769 leader_election.cc:302] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:53.184816 23710 raft_consensus.cc:2454] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:53.169682 24795 raft_consensus.cc:482] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:53.187563 23769 leader_election.cc:302] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
W20260807 13:40:53.176750 24988 log.cc:924] Time spent T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.142s user 0.002s sys 0.000s
I20260807 13:40:53.190033 23555 leader_election.cc:302] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:53.192615 23772 leader_election.cc:302] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:53.194278 23769 leader_election.cc:302] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:53.177095 24781 raft_consensus.cc:482] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:53.179744 24610 raft_consensus.cc:2726] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:53.200974 23769 leader_election.cc:302] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:53.205024 24979 raft_consensus.cc:2781] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:53.209226 24979 raft_consensus.cc:482] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:53.209815 24979 raft_consensus.cc:3037] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:53.212579 24853 leader_election.cc:288] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:53.199342 24976 raft_consensus.cc:2726] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 13:40:53.176952 24982 consensus_queue.cc:1159] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260807 13:40:53.191959 24800 raft_consensus.cc:2781] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:40:53.216620 24800 raft_consensus.cc:482] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:53.217010 24800 raft_consensus.cc:3037] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:53.219038 24984 raft_consensus.cc:2781] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:53.219713 24984 raft_consensus.cc:482] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:53.220312 24984 raft_consensus.cc:3037] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:53.208304 24941 raft_consensus.cc:2781] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260807 13:40:53.227900 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 51519.4us
I20260807 13:40:53.189687 24795 raft_consensus.cc:3037] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
W20260807 13:40:53.244793 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 43925.7us
I20260807 13:40:53.213274 24853 consensus_queue.cc:1035] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.024s
I20260807 13:40:53.189213 24905 consensus_queue.cc:1035] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260807 13:40:53.191562 24876 raft_consensus.cc:2781] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:40:53.271247 24876 raft_consensus.cc:686] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:53.272869 24876 consensus_queue.cc:237] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.228016 24781 raft_consensus.cc:504] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.176759 24719 consensus_queue.cc:1046] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260807 13:40:53.241607 24872 raft_consensus.cc:504] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.242805 24941 raft_consensus.cc:482] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:53.280444 24941 raft_consensus.cc:3037] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:53.243224 24610 consensus_queue.cc:1035] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:53.250810 23772 leader_election.cc:302] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
W20260807 13:40:53.283857 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 55031.1us
I20260807 13:40:53.285544 23772 leader_election.cc:302] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:53.251688 24605 leader_election.cc:288] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:53.287004 24986 raft_consensus.cc:2726] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:40:53.287916 24986 consensus_queue.cc:1035] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:53.290455 24976 consensus_queue.cc:1035] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:53.264545 24977 raft_consensus.cc:2781] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:53.267865 24853 raft_consensus.cc:2781] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260807 13:40:53.296403 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 115852us
I20260807 13:40:53.296891 24781 leader_election.cc:288] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:53.273993 24800 raft_consensus.cc:504] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
W20260807 13:40:53.307227 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 132682us
I20260807 13:40:53.294939 24872 leader_election.cc:288] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:53.318252 23662 leader_election.cc:302] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:53.295773 24859 raft_consensus.cc:2726] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:40:53.299049 24853 raft_consensus.cc:482] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:53.299453 24905 raft_consensus.cc:482] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:53.335644 23772 leader_election.cc:302] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:53.336776 24859 raft_consensus.cc:2781] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:53.337486 24859 raft_consensus.cc:686] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:53.338605 24859 consensus_queue.cc:237] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.345376 23772 leader_election.cc:302] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:53.346660 24986 raft_consensus.cc:2726] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:53.311815 24977 raft_consensus.cc:686] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:53.348939 25000 consensus_queue.cc:1035] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:53.349409 24977 consensus_queue.cc:237] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.322105 24739 raft_consensus.cc:482] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:53.354769 24583 consensus_queue.cc:1046] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260807 13:40:53.320523 24888 raft_consensus.cc:3032] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:53.326098 24853 raft_consensus.cc:3037] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:53.311651 24858 consensus_queue.cc:1035] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260807 13:40:53.350836 25004 raft_consensus.cc:482] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:40:53.362536 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 172610us
I20260807 13:40:53.350793 24995 raft_consensus.cc:2726] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:40:53.352560 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:53.365365 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 47227.6us
I20260807 13:40:53.360203 24965 raft_consensus.cc:2726] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:53.368006 23814 raft_consensus.cc:2454] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:53.329007 24872 consensus_queue.cc:1035] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260807 13:40:53.368029 24781 consensus_queue.cc:1035] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260807 13:40:53.357158 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:53.399962 23555 leader_election.cc:302] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:53.329025 24905 raft_consensus.cc:504] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.376817 24984 raft_consensus.cc:504] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.357599 25000 raft_consensus.cc:3037] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:53.382741 24795 raft_consensus.cc:504] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.384014 24583 raft_consensus.cc:3032] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:53.366781 25004 raft_consensus.cc:504] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.360940 24888 raft_consensus.cc:729] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
W20260807 13:40:53.395320 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 87372.7us
I20260807 13:40:53.375895 24748 raft_consensus.cc:504] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.390017 23662 leader_election.cc:302] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:53.401866 23772 leader_election.cc:302] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
W20260807 13:40:53.420420 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 156551us
I20260807 13:40:53.422536 23555 leader_election.cc:302] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:53.359247 24976 consensus_queue.cc:1046] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260807 13:40:53.362504 24739 raft_consensus.cc:504] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.427342 23554 leader_election.cc:302] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:53.431505 24960 consensus_queue.cc:1035] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260807 13:40:53.433144 25004 leader_election.cc:288] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:53.433229 24739 leader_election.cc:288] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:53.433947 24739 raft_consensus.cc:2726] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:53.435772 24979 raft_consensus.cc:504] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.422194 23709 raft_consensus.cc:3037] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:53.422863 24583 raft_consensus.cc:729] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:53.444098 23555 leader_election.cc:302] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:53.444195 23554 leader_election.cc:302] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:53.419605 24853 raft_consensus.cc:504] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:53.451197 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 58013.2us
I20260807 13:40:53.423578 24800 leader_election.cc:288] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187)
W20260807 13:40:53.452876 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 85784us
I20260807 13:40:53.428632 23699 raft_consensus.cc:1261] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:40:53.429289 24995 raft_consensus.cc:2726] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:53.458700 23555 leader_election.cc:302] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:53.401129 24799 consensus_queue.cc:1035] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260807 13:40:53.468763 24888 consensus_queue.cc:260] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.477630 24583 consensus_queue.cc:260] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.478556 24888 raft_consensus.cc:3037] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:53.480064 24979 leader_election.cc:288] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:53.442740 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:53.482771 23700 raft_consensus.cc:3037] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:53.484752 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:53.451977 24781 raft_consensus.cc:2781] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:53.485402 23772 leader_election.cc:302] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:53.478477 24960 raft_consensus.cc:3032] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:53.452910 24739 raft_consensus.cc:2781] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:53.485798 23814 raft_consensus.cc:2454] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:53.494437 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:53.494819 23555 leader_election.cc:302] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:53.457154 24859 raft_consensus.cc:2726] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:53.505664 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:53.508270 23821 raft_consensus.cc:2454] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:40:53.509896 23554 leader_election.cc:302] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:53.480113 24583 raft_consensus.cc:3037] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:53.511651 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:53.522694 23825 raft_consensus.cc:2454] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:53.492084 24960 raft_consensus.cc:729] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:53.493304 24995 raft_consensus.cc:2726] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:40:53.495671 24739 raft_consensus.cc:482] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:53.497339 24905 leader_election.cc:288] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:53.507095 24795 leader_election.cc:288] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:53.521507 24956 consensus_queue.cc:1046] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260807 13:40:53.529491 24986 raft_consensus.cc:482] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:53.529882 23660 leader_election.cc:302] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:53.498759 24872 raft_consensus.cc:2726] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:40:53.542335 24859 raft_consensus.cc:482] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:53.562680 24739 raft_consensus.cc:3037] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:40:53.541117 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 84820.5us
W20260807 13:40:53.580470 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 50697.3us
I20260807 13:40:53.567039 24995 raft_consensus.cc:2726] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:40:53.569061 24795 raft_consensus.cc:482] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:53.569742 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:53.571907 25015 raft_consensus.cc:482] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:53.540735 24979 consensus_queue.cc:1046] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260807 13:40:53.583664 24905 raft_consensus.cc:482] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:53.579836 24781 raft_consensus.cc:686] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:53.587963 24859 raft_consensus.cc:504] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.606165 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac6e18ecd14ba2a7d3e846a9fc81bf" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:53.611246 23699 raft_consensus.cc:3037] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:53.613757 25017 raft_consensus.cc:2781] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:53.582947 24986 raft_consensus.cc:504] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.607782 25015 raft_consensus.cc:504] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.617622 24986 leader_election.cc:288] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:53.592026 24858 consensus_queue.cc:1035] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260807 13:40:53.621599 24905 raft_consensus.cc:504] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.601723 23814 raft_consensus.cc:3037] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:53.625104 24834 raft_consensus.cc:482] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:53.625339 24979 raft_consensus.cc:3032] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:53.610142 25025 raft_consensus.cc:2781] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:40:53.627445 25025 raft_consensus.cc:482] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:53.627343 24719 raft_consensus.cc:3032] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:53.628131 25025 raft_consensus.cc:3037] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:40:53.628237 24719 raft_consensus.cc:729] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:53.628270 25015 leader_election.cc:288] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:53.600050 24995 raft_consensus.cc:482] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:53.628154 24859 leader_election.cc:288] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:53.625993 24979 raft_consensus.cc:729] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:53.653728 24995 raft_consensus.cc:504] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.655584 25001 raft_consensus.cc:2781] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:53.625974 24834 raft_consensus.cc:504] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.656277 25001 raft_consensus.cc:482] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:53.656774 25001 raft_consensus.cc:3037] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:53.657727 24995 leader_election.cc:288] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:53.629417 25021 consensus_queue.cc:1035] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260807 13:40:53.661602 24999 raft_consensus.cc:2726] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:53.663360 24834 leader_election.cc:288] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:53.601181 25007 raft_consensus.cc:482] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:53.654665 24979 consensus_queue.cc:260] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.629954 24719 consensus_queue.cc:260] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.667200 24979 raft_consensus.cc:3037] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:53.667048 25007 raft_consensus.cc:504] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.668109 24719 raft_consensus.cc:3037] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:53.599994 24984 leader_election.cc:288] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:53.673180 23709 raft_consensus.cc:2454] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 4.
I20260807 13:40:53.614815 25017 raft_consensus.cc:686] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:53.688179 23700 raft_consensus.cc:2454] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 4.
I20260807 13:40:53.704303 25007 leader_election.cc:288] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:53.604961 24795 raft_consensus.cc:504] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:53.746995 24972 log.cc:924] Time spent T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.052s user 0.001s sys 0.000s
I20260807 13:40:53.747268 25021 raft_consensus.cc:482] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:53.677350 24853 leader_election.cc:288] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:53.750670 25021 raft_consensus.cc:504] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.757154 25010 raft_consensus.cc:482] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:53.757320 24795 leader_election.cc:288] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:53.757813 24781 consensus_queue.cc:237] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.758934 25007 raft_consensus.cc:482] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:53.754158 23699 raft_consensus.cc:2454] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:53.760537 24976 raft_consensus.cc:482] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:53.761099 24941 raft_consensus.cc:504] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.763583 24719 raft_consensus.cc:482] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:53.768446 23814 raft_consensus.cc:2454] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:40:53.783738 25007 raft_consensus.cc:504] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.631891 24960 consensus_queue.cc:260] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:53.787288 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 215561us
W20260807 13:40:53.803248 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 308544us
I20260807 13:40:53.809520 23555 leader_election.cc:302] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:53.810879 24795 raft_consensus.cc:2726] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:53.811475 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:53.816766 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:53.811484 23555 leader_election.cc:302] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:53.822254 23555 leader_election.cc:302] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:53.823329 23699 raft_consensus.cc:3037] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:53.781272 25010 raft_consensus.cc:504] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.840718 24795 raft_consensus.cc:2726] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:53.812564 25017 consensus_queue.cc:237] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.802259 24976 raft_consensus.cc:504] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.860705 24976 leader_election.cc:288] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:53.863474 24905 leader_election.cc:288] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:53.798534 24719 raft_consensus.cc:504] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.852263 24941 leader_election.cc:288] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:53.866185 25007 leader_election.cc:288] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:53.869326 24719 leader_election.cc:288] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:53.854545 25021 leader_election.cc:288] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:53.888320 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 66167.7us
I20260807 13:40:53.889334 23555 leader_election.cc:302] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:53.861835 25001 raft_consensus.cc:504] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.850433 24739 raft_consensus.cc:504] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.897235 25000 raft_consensus.cc:2726] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:53.901700 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:53.898579 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:53.909992 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
W20260807 13:40:53.920670 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 410892us
I20260807 13:40:53.884980 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:53.917091 23820 raft_consensus.cc:2454] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:53.923277 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:53.925066 23823 raft_consensus.cc:2454] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:53.901069 24795 raft_consensus.cc:2726] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:53.934190 23769 leader_election.cc:302] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:53.929296 23554 leader_election.cc:302] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:53.917140 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:53.946197 23769 leader_election.cc:302] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:53.947901 24583 raft_consensus.cc:2781] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:40:53.948158 23769 leader_election.cc:302] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:53.948865 24583 raft_consensus.cc:686] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:53.950184 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:53.927177 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:53.924196 24853 raft_consensus.cc:2781] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:53.951229 23814 raft_consensus.cc:2379] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 4: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
W20260807 13:40:53.953222 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 43790.9us
I20260807 13:40:53.921877 23709 raft_consensus.cc:2454] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:53.957823 23555 leader_election.cc:302] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:53.950836 24795 raft_consensus.cc:2781] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:53.952517 24977 raft_consensus.cc:2781] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:53.971622 23554 leader_election.cc:302] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:53.956228 23813 raft_consensus.cc:2454] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:53.961591 24795 raft_consensus.cc:482] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:53.984131 23660 leader_election.cc:302] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:53.985268 23660 leader_election.cc:302] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:53.962256 24853 raft_consensus.cc:686] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:53.987593 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:53.987841 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:53.988220 23555 leader_election.cc:302] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:53.989784 23769 leader_election.cc:302] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
W20260807 13:40:53.986397 24651 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.500s user 0.001s sys 0.026s
I20260807 13:40:53.990756 25021 raft_consensus.cc:2781] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:53.993278 25021 raft_consensus.cc:482] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:53.993678 25021 raft_consensus.cc:3037] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:53.994282 25037 raft_consensus.cc:2726] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:53.981081 25027 raft_consensus.cc:482] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:53.996179 25027 raft_consensus.cc:504] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.993129 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:53.968039 23812 raft_consensus.cc:2454] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:54.001166 23702 raft_consensus.cc:2454] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:53.998471 25027 leader_election.cc:288] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:53.980250 24977 raft_consensus.cc:686] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
W20260807 13:40:54.000742 24651 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.506s user 0.001s sys 0.026s
I20260807 13:40:53.989673 24795 raft_consensus.cc:3037] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:54.011241 23555 leader_election.cc:302] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:54.018764 24853 consensus_queue.cc:237] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:53.990782 24965 raft_consensus.cc:2781] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:54.003633 25024 raft_consensus.cc:2781] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:40:54.011304 23769 leader_election.cc:302] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:54.025995 23555 leader_election.cc:302] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:54.029373 23660 leader_election.cc:302] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:54.005709 24876 raft_consensus.cc:2781] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:54.027513 24965 raft_consensus.cc:482] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:54.034502 25004 raft_consensus.cc:2726] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:40:54.006587 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:53.968078 24583 consensus_queue.cc:237] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:54.034859 25038 consensus_queue.cc:1035] T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:40:54.025682 25037 raft_consensus.cc:2781] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:40:54.028661 24739 leader_election.cc:288] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:54.025260 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9552d42b445450691daef21fba4059a" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:54.032712 24888 raft_consensus.cc:2726] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:54.063822 23660 leader_election.cc:302] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:54.067474 23711 raft_consensus.cc:1261] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:40:54.067777 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:54.068121 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:54.031394 24956 raft_consensus.cc:2781] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:54.068655 23598 raft_consensus.cc:2362] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2. Re-sending same reply.
I20260807 13:40:54.035028 25002 consensus_queue.cc:1035] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260807 13:40:54.069684 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:54.038801 23709 raft_consensus.cc:1226] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 3. Current term is 4. Ops: []
I20260807 13:40:54.037233 24876 raft_consensus.cc:482] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:54.068449 23599 raft_consensus.cc:2362] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3. Re-sending same reply.
I20260807 13:40:54.072111 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:54.037508 25024 raft_consensus.cc:686] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:54.072788 23594 raft_consensus.cc:2454] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:54.060449 25027 raft_consensus.cc:482] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:54.035738 25028 raft_consensus.cc:2781] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:40:54.074640 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:54.087899 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:54.088588 23600 raft_consensus.cc:2454] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:54.089442 23588 raft_consensus.cc:1226] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:54.089510 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:54.090719 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:54.091216 25044 raft_consensus.cc:482] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:54.091548 23588 raft_consensus.cc:2379] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 3: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:54.091898 24800 raft_consensus.cc:3032] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:54.091667 25044 raft_consensus.cc:504] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:54.092298 24800 raft_consensus.cc:729] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:54.092423 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:54.088596 25023 raft_consensus.cc:2781] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:54.093137 25023 raft_consensus.cc:482] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:54.093513 25023 raft_consensus.cc:3037] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:54.093254 24800 consensus_queue.cc:260] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:54.093961 25044 leader_election.cc:288] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:54.090592 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:54.037735 24965 raft_consensus.cc:3037] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:54.071645 24979 consensus_queue.cc:1035] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260807 13:40:54.097554 23600 raft_consensus.cc:2454] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:54.100728 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:54.101372 23600 raft_consensus.cc:3037] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
W20260807 13:40:54.103854 25040 log.cc:924] Time spent T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.076s user 0.002s sys 0.000s
I20260807 13:40:54.105402 25027 raft_consensus.cc:504] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:54.072732 25004 consensus_queue.cc:1035] T 0dc716b3423f48deb7798cbf9e86d821 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260807 13:40:54.107620 25027 leader_election.cc:288] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:54.108687 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:54.109265 23599 raft_consensus.cc:2362] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2. Re-sending same reply.
I20260807 13:40:54.075901 23601 raft_consensus.cc:2396] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:40:54.034899 23699 raft_consensus.cc:2454] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:54.076434 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:54.072105 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:54.115140 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:54.071758 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:54.120533 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:54.078583 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f8a5f186bf1473a988921e5efa3e574" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:54.078876 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:54.145768 23594 raft_consensus.cc:2362] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3. Re-sending same reply.
I20260807 13:40:54.079212 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:54.059042 25001 leader_election.cc:288] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:54.063659 23704 raft_consensus.cc:1261] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:54.080644 25043 consensus_queue.cc:1035] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260807 13:40:54.150367 24952 raft_consensus.cc:482] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:54.075306 25010 leader_election.cc:288] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:54.111027 23662 leader_election.cc:334] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Timed out: RequestConsensusVote RPC to 127.21.82.65:33187 timed out after 1.523s (SENT)
I20260807 13:40:54.150616 23700 raft_consensus.cc:2454] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
W20260807 13:40:54.152616 23662 leader_election.cc:334] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Timed out: RequestConsensusVote RPC to 127.21.82.65:33187 timed out after 1.530s (SENT)
I20260807 13:40:54.059978 24995 consensus_queue.cc:1035] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.049s
I20260807 13:40:54.153129 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:54.112584 25028 raft_consensus.cc:686] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:54.122241 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:54.122483 23703 raft_consensus.cc:1226] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:54.077853 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:54.123237 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:54.123350 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:54.116365 23598 raft_consensus.cc:2396] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:40:54.122519 25023 raft_consensus.cc:504] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:54.124048 24745 raft_consensus.cc:3037] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:54.039758 25017 consensus_queue.cc:1035] T 7e285d5ba5024cee8ad635138ef44fd5 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260807 13:40:54.129370 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:54.130095 24888 raft_consensus.cc:482] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:54.058521 25025 raft_consensus.cc:504] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:54.135751 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:54.081429 24977 consensus_queue.cc:237] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:54.067888 25037 raft_consensus.cc:686] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:54.170168 23600 raft_consensus.cc:2454] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:40:54.094285 24800 raft_consensus.cc:3037] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:54.072491 24956 raft_consensus.cc:482] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:54.143296 23705 raft_consensus.cc:1261] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:54.143498 25024 consensus_queue.cc:237] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:54.076908 24876 raft_consensus.cc:3037] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:54.149264 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:54.111459 23772 leader_election.cc:302] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:54.153352 23707 raft_consensus.cc:1226] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 2. Current term is 3. Ops: []
W20260807 13:40:54.153525 23662 leader_election.cc:334] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Timed out: RequestConsensusVote RPC to 127.21.82.65:33187 timed out after 1.575s (SENT)
I20260807 13:40:54.149273 23590 raft_consensus.cc:2362] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1. Re-sending same reply.
I20260807 13:40:54.156011 25033 raft_consensus.cc:2781] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:40:54.158537 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:54.186252 23703 raft_consensus.cc:2454] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:54.187423 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:54.159461 23595 raft_consensus.cc:2379] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 3: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:54.144802 24748 leader_election.cc:288] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:54.153882 23591 raft_consensus.cc:2379] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:54.164036 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:54.177026 24956 raft_consensus.cc:3037] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:54.154896 24960 raft_consensus.cc:3037] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:54.168468 23601 raft_consensus.cc:3037] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:54.138324 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:54.171015 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:54.160740 25043 raft_consensus.cc:482] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:54.175776 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:54.198995 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:54.199239 23600 raft_consensus.cc:3037] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:40:54.199275 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 87883.9us
I20260807 13:40:54.199906 23703 raft_consensus.cc:2379] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:54.161636 23700 raft_consensus.cc:3037] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:54.165822 25038 raft_consensus.cc:482] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:54.236485 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:54.236783 25038 raft_consensus.cc:504] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:54.182226 23662 leader_election.cc:302] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:54.185159 23594 raft_consensus.cc:2454] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
W20260807 13:40:54.238901 25048 log.cc:924] Time spent T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.111s user 0.000s sys 0.002s
W20260807 13:40:54.239701 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 86196.9us
I20260807 13:40:54.239864 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:54.240367 23662 leader_election.cc:334] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: RPC error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Timed out: RequestConsensusVote RPC to 127.21.82.65:33187 timed out after 1.605s (SENT)
I20260807 13:40:54.240561 23594 raft_consensus.cc:2454] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:54.240872 23662 leader_election.cc:302] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:54.241602 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:54.242260 23594 raft_consensus.cc:2454] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:54.185552 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:54.242532 23662 leader_election.cc:302] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:54.246881 23711 raft_consensus.cc:2454] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:40:54.247442 24941 raft_consensus.cc:2741] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260807 13:40:54.247916 23662 leader_election.cc:302] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:54.243013 25001 raft_consensus.cc:2726] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:40:54.167748 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9552d42b445450691daef21fba4059a" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:54.249101 24941 raft_consensus.cc:2781] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:40:54.249580 23662 leader_election.cc:302] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:54.249734 24941 raft_consensus.cc:482] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:54.250391 24941 raft_consensus.cc:3037] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:54.250752 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:54.251816 23709 raft_consensus.cc:2454] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:54.253206 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:54.253960 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:54.254324 23709 raft_consensus.cc:2379] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:54.191843 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:54.253845 24795 raft_consensus.cc:504] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:54.254904 23818 raft_consensus.cc:3037] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:54.255813 23588 raft_consensus.cc:2379] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 3: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:54.165232 23813 raft_consensus.cc:2454] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:54.193835 25023 leader_election.cc:288] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:54.184588 25049 log.cc:924] Time spent T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.054s user 0.000s sys 0.002s
I20260807 13:40:54.198135 23598 raft_consensus.cc:2396] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:40:54.260362 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:54.260950 23598 raft_consensus.cc:3037] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:54.261225 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:54.164628 23812 raft_consensus.cc:3037] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:54.265784 23818 raft_consensus.cc:2454] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:54.200290 23772 leader_election.cc:302] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
W20260807 13:40:54.267359 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 67166.9us
I20260807 13:40:54.267680 23601 raft_consensus.cc:2454] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:54.268532 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:54.269058 23601 raft_consensus.cc:3037] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:54.268992 23772 leader_election.cc:302] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:54.270432 25027 raft_consensus.cc:2726] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:54.270881 24859 raft_consensus.cc:2726] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:54.202059 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac6e18ecd14ba2a7d3e846a9fc81bf" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:54.271309 25027 raft_consensus.cc:482] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:54.248096 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:54.272260 23711 raft_consensus.cc:3037] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:54.271914 25027 raft_consensus.cc:504] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:54.272682 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:54.273635 23595 raft_consensus.cc:2354] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
I20260807 13:40:54.202436 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac6e18ecd14ba2a7d3e846a9fc81bf" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:54.274835 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:54.275389 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:54.276183 23599 raft_consensus.cc:2379] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:54.276893 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:54.277333 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:54.277477 23599 raft_consensus.cc:2454] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:54.204427 25025 leader_election.cc:288] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:54.205528 25021 raft_consensus.cc:504] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:54.207333 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:54.279239 23591 raft_consensus.cc:3037] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
W20260807 13:40:54.280682 25016 log.cc:924] Time spent T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.802s user 0.000s sys 0.003s
I20260807 13:40:54.281015 25021 leader_election.cc:288] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:54.208568 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:54.185873 25033 raft_consensus.cc:482] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:54.282924 23590 raft_consensus.cc:3037] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:54.283110 25033 raft_consensus.cc:3037] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:54.283615 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:54.284296 23709 raft_consensus.cc:3037] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:40:54.209429 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9552d42b445450691daef21fba4059a" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:54.189324 25028 consensus_queue.cc:237] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
I20260807 13:40:54.288034 23447 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37954 (request call id 130) took 1319 ms. Trace:
I20260807 13:40:54.169715 24888 raft_consensus.cc:504] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:54.151089 24952 raft_consensus.cc:504] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:54.222872 25043 raft_consensus.cc:504] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:54.228482 25012 log.cc:924] Time spent T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.800s user 0.003s sys 0.001s
I20260807 13:40:54.230244 25022 raft_consensus.cc:482] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:54.195592 25037 consensus_queue.cc:237] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:54.312081 23711 raft_consensus.cc:2454] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:54.231747 24965 raft_consensus.cc:504] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:54.262157 23588 raft_consensus.cc:2454] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:54.278275 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:54.318904 23599 raft_consensus.cc:2379] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:54.290995 23662 leader_election.cc:302] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:54.288441 23447 rpcz_store.cc:276] 0807 13:40:52.968955 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:52.978809 (+ 9854us) service_pool.cc:227] Handling call
0807 13:40:54.287973 (+1309164us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:40:53.179879 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:40:53.223371 (+ 43492us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:40:53.223459 (+ 88us) write_op.cc:435] Acquired schema lock
0807 13:40:53.223499 (+ 40us) tablet.cc:660] Decoding operations
0807 13:40:53.224529 (+ 1030us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:40:53.224628 (+ 99us) write_op.cc:641] Partition lock acquired for write op
0807 13:40:53.224676 (+ 48us) tablet.cc:683] Acquiring locks for 3 operations
0807 13:40:53.225267 (+ 591us) tablet.cc:699] Row locks acquired
0807 13:40:53.225298 (+ 31us) write_op.cc:260] PREPARE: finished
0807 13:40:53.295678 (+ 70380us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b2c00100d58. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461aa90e11 00007f461aa9fada 00007f461aa9f763 00007f461aa9f701 00007f461c0e8b12 00007f461c0e88ed 00007f461fabc7a0 00007f461fabc2b8 00007f461fac0ba1 00007f461fac0b59 00007f461fac0ae9
0807 13:40:53.300604 (+ 4926us) write_op.cc:270] Start()
0807 13:40:53.322325 (+ 21721us) write_op.cc:276] Timestamp: P: 1786110053245101 usec, L: 0
0807 13:40:53.322356 (+ 31us) op_driver.cc:331] REPLICATION: starting
0807 13:40:53.368230 (+ 45874us) log.cc:842] Serialized 1307 byte log entry
0807 13:40:53.372480 (+ 4250us) op_driver.cc:444] REPLICATION: finished
0807 13:40:53.372918 (+ 438us) write_op.cc:301] APPLY: starting
0807 13:40:53.373008 (+ 90us) tablet.cc:1365] starting BulkCheckPresence
0807 13:40:53.373158 (+ 150us) tablet.cc:1368] finished BulkCheckPresence
0807 13:40:53.373178 (+ 20us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:40:53.373532 (+ 354us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:40:53.373706 (+ 174us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0807 13:40:53.373759 (+ 53us) write_op.cc:312] APPLY: finished
0807 13:40:53.373990 (+ 231us) log.cc:842] Serialized 34 byte log entry
0807 13:40:53.374142 (+ 152us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:40:53.374263 (+ 121us) write_op.cc:454] Released schema lock
0807 13:40:53.374307 (+ 44us) write_op.cc:341] FINISH: Updating metrics
0807 13:40:53.374553 (+ 246us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:40:53.374580 (+ 27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":211,"apply.run_cpu_time_us":1983,"apply.run_wall_time_us":22649,"num_ops":3,"prepare.queue_time_us":7516,"prepare.run_cpu_time_us":8672,"prepare.run_wall_time_us":193626,"replication_time_us":47437,"spinlock_wait_cycles":45117824}]]}
I20260807 13:40:54.321167 23662 leader_election.cc:302] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:54.291561 23555 leader_election.cc:302] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:54.260362 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:54.259060 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:54.282943 23600 raft_consensus.cc:2454] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:54.304569 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:54.322510 23703 raft_consensus.cc:3037] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:54.323011 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:54.322531 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 55955.2us
I20260807 13:40:54.323750 23600 raft_consensus.cc:2362] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3. Re-sending same reply.
I20260807 13:40:54.325047 23555 leader_election.cc:302] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:54.305433 23601 raft_consensus.cc:2454] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:54.295596 25027 leader_election.cc:288] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:54.313092 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
W20260807 13:40:54.313985 25045 log.cc:924] Time spent T e1e9a929f1fe4faeb8fc3a072191c41a P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.278s user 0.000s sys 0.003s
I20260807 13:40:54.328665 23823 raft_consensus.cc:3037] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:54.276418 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:54.346877 23662 leader_election.cc:302] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:54.343796 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:54.349582 23599 raft_consensus.cc:2454] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:54.349741 23769 leader_election.cc:302] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:54.351050 23599 raft_consensus.cc:1261] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:54.331959 23555 leader_election.cc:302] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:54.343248 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:54.352891 23555 leader_election.cc:302] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:54.334926 23554 leader_election.cc:302] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:54.296568 24795 leader_election.cc:288] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:54.339537 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:54.339973 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:54.340776 23588 raft_consensus.cc:1261] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:40:54.366859 23660 leader_election.cc:302] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:54.341348 25025 raft_consensus.cc:2726] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:40:54.341478 25001 raft_consensus.cc:2726] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:40:54.342101 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:54.241604 24905 raft_consensus.cc:2726] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:54.354915 23555 leader_election.cc:302] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
W20260807 13:40:54.408007 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 53185.9us
I20260807 13:40:54.408942 23555 leader_election.cc:302] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:54.313138 25022 raft_consensus.cc:504] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:54.356658 23703 raft_consensus.cc:2454] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:40:54.364717 23823 raft_consensus.cc:2454] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:54.342222 25015 consensus_queue.cc:1046] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:40:54.414714 23555 leader_election.cc:302] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:54.366485 23769 leader_election.cc:302] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:54.334640 24719 raft_consensus.cc:2726] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:40:54.377724 23709 raft_consensus.cc:2454] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 5.
W20260807 13:40:54.406499 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 59698us
I20260807 13:40:54.406775 23600 raft_consensus.cc:2354] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
I20260807 13:40:54.412428 23598 raft_consensus.cc:2454] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 4.
W20260807 13:40:54.418926 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 52537.4us
I20260807 13:40:54.347992 25038 leader_election.cc:288] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:54.420843 23662 leader_election.cc:302] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:54.427175 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:54.427860 23823 raft_consensus.cc:3037] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:40:54.428400 23662 leader_election.cc:302] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
W20260807 13:40:54.417819 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 51058.5us
I20260807 13:40:54.430052 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:54.430691 23703 raft_consensus.cc:2454] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:54.360508 24853 raft_consensus.cc:2726] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:40:54.367492 24859 raft_consensus.cc:2781] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:54.437215 23662 leader_election.cc:302] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:54.437052 25023 raft_consensus.cc:2781] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:54.432130 24651 raft_consensus.cc:2726] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:40:54.451740 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:54.376066 23814 raft_consensus.cc:3037] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:54.375594 25021 raft_consensus.cc:2741] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260807 13:40:54.437970 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:54.438902 25025 raft_consensus.cc:2781] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:54.439456 23769 leader_election.cc:302] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:54.406090 24995 raft_consensus.cc:2741] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260807 13:40:54.439644 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:54.440557 23660 leader_election.cc:302] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:54.418864 24739 raft_consensus.cc:2726] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:54.441967 25001 raft_consensus.cc:2726] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:40:54.340005 25002 consensus_queue.cc:1035] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.083s
I20260807 13:40:54.449743 23823 raft_consensus.cc:2454] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 5.
I20260807 13:40:54.455534 23818 raft_consensus.cc:2379] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:54.359050 23595 raft_consensus.cc:2362] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3. Re-sending same reply.
I20260807 13:40:54.432358 24976 raft_consensus.cc:2781] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:40:54.377015 24800 consensus_queue.cc:1035] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.086s
I20260807 13:40:54.422951 25046 raft_consensus.cc:2726] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:54.375515 25027 consensus_queue.cc:1046] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.088s
I20260807 13:40:54.505923 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:54.474062 23660 leader_election.cc:302] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:54.471115 24984 raft_consensus.cc:2781] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:40:54.487200 25032 raft_consensus.cc:2781] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:54.468447 24859 raft_consensus.cc:686] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:54.474118 23662 leader_election.cc:302] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:54.510020 23710 raft_consensus.cc:2454] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:54.488662 24781 raft_consensus.cc:2726] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:40:54.525663 23554 leader_election.cc:302] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:54.499637 24905 raft_consensus.cc:2781] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:54.489566 24976 raft_consensus.cc:482] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:54.499250 25023 raft_consensus.cc:686] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
W20260807 13:40:54.536562 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 62587.7us
I20260807 13:40:54.540505 23769 leader_election.cc:302] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:54.545368 25032 raft_consensus.cc:686] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
W20260807 13:40:54.546888 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 72873.8us
I20260807 13:40:54.536012 24976 raft_consensus.cc:3037] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:54.547875 23662 leader_election.cc:302] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:54.546998 25015 raft_consensus.cc:2781] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:40:54.507587 24984 raft_consensus.cc:482] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:54.535835 24739 raft_consensus.cc:2781] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:40:54.556911 24781 raft_consensus.cc:2726] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 13:40:54.586396 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 154243us
I20260807 13:40:54.598191 23555 leader_election.cc:302] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:54.562530 24984 raft_consensus.cc:3037] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:54.563303 24979 raft_consensus.cc:482] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:54.580236 25025 raft_consensus.cc:686] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:54.618753 23772 leader_election.cc:302] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:54.566114 24888 leader_election.cc:288] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:54.569461 25027 raft_consensus.cc:2781] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260807 13:40:54.639364 25047 log.cc:924] Time spent T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.518s user 0.009s sys 0.002s
I20260807 13:40:54.587534 25044 raft_consensus.cc:3037] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:54.657848 23772 leader_election.cc:302] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:40:54.609664 24952 leader_election.cc:288] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:54.603161 24965 leader_election.cc:288] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:54.607551 25015 raft_consensus.cc:686] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:54.602581 25043 leader_election.cc:288] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:54.641206 23817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45370 (request call id 349) took 1112 ms. Trace:
I20260807 13:40:54.644447 24739 raft_consensus.cc:686] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:54.642946 24905 raft_consensus.cc:686] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:54.635406 24979 raft_consensus.cc:504] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:54.648244 25027 raft_consensus.cc:482] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:54.648769 24872 raft_consensus.cc:482] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:54.634517 24781 raft_consensus.cc:482] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
W20260807 13:40:54.896572 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 238820us
I20260807 13:40:54.633002 24859 consensus_queue.cc:237] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:54.802912 25022 leader_election.cc:288] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:54.913646 25030 log.cc:924] Time spent T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.913s user 0.000s sys 0.016s
I20260807 13:40:54.914283 25070 raft_consensus.cc:482] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:54.915279 25002 raft_consensus.cc:482] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:54.667663 24800 raft_consensus.cc:482] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:40:54.908022 24941 consensus_meta.cc:287] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.657s user 0.011s sys 0.002s
I20260807 13:40:54.667521 24860 raft_consensus.cc:2781] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:54.733565 25025 consensus_queue.cc:237] T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:54.901252 24982 raft_consensus.cc:2781] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:40:54.909579 25017 raft_consensus.cc:2726] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:40:54.921478 25062 raft_consensus.cc:482] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:40:54.944478 23591 consensus_meta.cc:287] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent flushing consensus metadata: real 0.656s user 0.013s sys 0.000s
I20260807 13:40:54.991285 23591 raft_consensus.cc:2454] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 4.
I20260807 13:40:54.991464 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:54.991197 25062 raft_consensus.cc:504] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:54.992782 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:54.993105 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:54.994040 23591 raft_consensus.cc:2379] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:54.932312 24719 raft_consensus.cc:482] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:54.932531 25027 raft_consensus.cc:3037] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:54.995926 23599 raft_consensus.cc:2379] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 3: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:54.844208 25023 consensus_queue.cc:237] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:54.692456 25032 consensus_queue.cc:237] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:54.981925 24982 raft_consensus.cc:482] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:54.926196 24888 raft_consensus.cc:482] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:40:54.978634 23700 consensus_meta.cc:287] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.732s user 0.011s sys 0.003s
W20260807 13:40:54.978026 24745 consensus_meta.cc:287] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.812s user 0.006s sys 0.008s
I20260807 13:40:55.020874 24960 raft_consensus.cc:482] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:55.021384 24979 leader_election.cc:288] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:40:55.022032 25067 log.cc:924] Time spent T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.116s user 0.000s sys 0.001s
I20260807 13:40:55.021754 24960 raft_consensus.cc:504] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:54.979223 24860 raft_consensus.cc:482] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:55.009949 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:54.973287 24876 consensus_meta.cc:287] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.783s user 0.008s sys 0.006s
I20260807 13:40:54.958192 24739 consensus_queue.cc:237] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.028678 24876 raft_consensus.cc:504] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:54.936120 24872 raft_consensus.cc:504] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:55.036118 25071 log.cc:924] Time spent T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.108s user 0.001s sys 0.000s
I20260807 13:40:55.038280 24876 leader_election.cc:288] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:54.978873 24800 raft_consensus.cc:504] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.016579 23700 raft_consensus.cc:2454] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
W20260807 13:40:55.039642 25033 consensus_meta.cc:287] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.756s user 0.012s sys 0.003s
I20260807 13:40:54.951310 25080 raft_consensus.cc:482] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:54.943408 24781 raft_consensus.cc:504] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.049439 24872 leader_election.cc:288] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:55.051371 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:55.078146 25058 log.cc:924] Time spent T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.379s user 0.001s sys 0.001s
I20260807 13:40:55.052110 24748 raft_consensus.cc:2726] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260807 13:40:55.081427 25057 log.cc:924] Time spent T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.323s user 0.005s sys 0.005s
I20260807 13:40:55.085531 24800 leader_election.cc:288] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:40:55.054952 25054 log.cc:924] Time spent T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.393s user 0.000s sys 0.002s
I20260807 13:40:55.055480 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:55.026484 25015 consensus_queue.cc:237] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:55.060829 25060 log.cc:924] Time spent T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.076s user 0.000s sys 0.000s
W20260807 13:40:55.061578 23812 consensus_meta.cc:287] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.799s user 0.010s sys 0.002s
W20260807 13:40:55.068966 25052 log.cc:924] Time spent T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.493s user 0.003s sys 0.003s
I20260807 13:40:55.008250 25062 leader_election.cc:288] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:55.071872 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:55.110634 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:55.017374 24982 raft_consensus.cc:3037] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:55.041142 24860 raft_consensus.cc:3037] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:54.982865 24941 raft_consensus.cc:504] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.025760 24888 raft_consensus.cc:504] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:54.928450 23817 rpcz_store.cc:276] 0807 13:40:53.500662 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:53.508035 (+ 7373us) service_pool.cc:227] Handling call
0807 13:40:54.159325 (+651290us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b5800255098. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f46210032b0 00007f4620fee7f9 00007f4620fee2a2 00007f461a6d4684
0807 13:40:54.159594 (+ 269us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:54.159948 (+ 354us) raft_consensus.cc:1520] Early marking committed up to index 3
0807 13:40:54.179411 (+ 19463us) log.cc:842] Serialized 14 byte log entry
0807 13:40:54.563488 (+384077us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:54.565720 (+ 2232us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:40:54.567632 (+ 1912us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:54.587337 (+ 19705us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:54.612642 (+ 25305us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14408,"prepare.queue_time_us":12005,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":19715,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":4495,"spinlock_wait_cycles":23979392,"thread_start_us":326140,"threads_started":1,"wal-append.queue_time_us":406513}
I20260807 13:40:55.098317 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:55.090438 23700 raft_consensus.cc:2454] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
W20260807 13:40:55.106096 25065 log.cc:924] Time spent T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.080s user 0.000s sys 0.002s
I20260807 13:40:55.107146 25078 raft_consensus.cc:3032] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:40:54.980237 25002 raft_consensus.cc:504] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:55.075589 23590 consensus_meta.cc:287] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent flushing consensus metadata: real 0.792s user 0.010s sys 0.007s
I20260807 13:40:55.008832 24719 raft_consensus.cc:504] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.124454 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 646) took 1119 ms. Trace:
I20260807 13:40:55.139549 23702 rpcz_store.cc:276] 0807 13:40:54.004967 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:54.005147 (+ 180us) service_pool.cc:227] Handling call
0807 13:40:54.005571 (+ 424us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:40:54.027589 (+ 22018us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:54.027623 (+ 34us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:40:54.033285 (+ 5662us) log.cc:842] Serialized 52 byte log entry
0807 13:40:54.128091 (+ 94806us) spinlock_profiling.cc:243] Waited 5.81 ms on lock 0x7b18002abb60. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f46220248b1 00007f4622031661 00007f4619167345 00007f4621f9ea39 00007f46191848bb 00007f4619182cbf 00007f4619184e22 00007f461bd2e5bb 00007f461bd34063 00007f461bd34411 00007f461c0815cf
0807 13:40:54.166276 (+ 38185us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:54.166331 (+ 55us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:54.166426 (+ 95us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:55.123951 (+957525us) raft_consensus.cc:1671] finished
0807 13:40:55.123983 (+ 32us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:55.124343 (+ 360us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4051,"raft.queue_time_us":12597,"raft.run_cpu_time_us":927,"raft.run_wall_time_us":12685,"spinlock_wait_cycles":13351680,"thread_start_us":38008,"threads_started":1,"wal-append.queue_time_us":303081}
I20260807 13:40:55.142704 23709 raft_consensus.cc:1261] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:54.980551 25070 raft_consensus.cc:504] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:55.133512 23600 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s user 0.010s sys 0.028s
I20260807 13:40:55.105053 25080 raft_consensus.cc:504] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.074738 25033 raft_consensus.cc:504] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.108582 23812 raft_consensus.cc:2454] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:55.041939 24905 consensus_queue.cc:237] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.147266 23599 raft_consensus.cc:2454] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
W20260807 13:40:55.146556 23600 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s user 0.010s sys 0.029s
W20260807 13:40:55.168375 25056 log.cc:924] Time spent T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.601s user 0.001s sys 0.000s
I20260807 13:40:55.143762 23590 raft_consensus.cc:2454] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 4.
I20260807 13:40:55.171116 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:55.178956 23812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 356) took 1151 ms. Trace:
I20260807 13:40:55.179073 24719 leader_election.cc:288] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:55.180087 24858 raft_consensus.cc:2726] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:55.186786 25063 raft_consensus.cc:482] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
F20260807 13:40:55.194031 21833 test_workload.cc:378] Timed out: Timed out waiting for Table Creation
*** Check failure stack trace: ***
*** Aborted at 1786110055 (unix time) try "date -d @1786110055" if you are using GNU date ***
W20260807 13:40:55.204226 23535 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:40:55.204957 23449 catalog_manager.cc:5495] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 reported cstate change: term changed from 2 to 3, leader changed from 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65) to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 3 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:40:55.173341 25078 raft_consensus.cc:729] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:55.186403 25033 leader_election.cc:288] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:55.208343 23704 raft_consensus.cc:2379] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 4: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
W20260807 13:40:55.205631 24956 consensus_meta.cc:287] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 1.003s user 0.014s sys 0.005s
I20260807 13:40:55.195252 25017 raft_consensus.cc:482] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:55.228012 24719 raft_consensus.cc:482] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:55.228607 24941 leader_election.cc:288] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:55.228734 25062 raft_consensus.cc:482] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:55.195608 23812 rpcz_store.cc:276] 0807 13:40:54.057241 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:54.064546 (+ 7305us) service_pool.cc:227] Handling call
0807 13:40:55.178837 (+1114291us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:40:55.216797 23814 consensus_meta.cc:287] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.744s user 0.009s sys 0.005s
I20260807 13:40:55.205340 23590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 613) took 1063 ms. Trace:
I20260807 13:40:55.212697 25063 raft_consensus.cc:504] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.216969 24795 raft_consensus.cc:2726] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:40:55.262558 25070 leader_election.cc:288] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:55.270047 24583 raft_consensus.cc:3032] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:40:55.418817 24583 raft_consensus.cc:729] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:40:55.271626 24888 leader_election.cc:288] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:55.273119 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:55.263903 24781 leader_election.cc:288] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:55.250067 25080 leader_election.cc:288] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:55.423538 23815 raft_consensus.cc:3037] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:55.243034 25038 raft_consensus.cc:482] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:55.427023 25038 raft_consensus.cc:504] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.284579 24745 raft_consensus.cc:482] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:55.326833 24982 raft_consensus.cc:504] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:55.327883 24984 consensus_meta.cc:287] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.685s user 0.007s sys 0.007s
I20260807 13:40:55.431558 24745 raft_consensus.cc:504] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.431994 24984 raft_consensus.cc:504] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.433940 24982 leader_election.cc:288] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:55.306309 25027 raft_consensus.cc:504] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.435184 24984 leader_election.cc:288] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:40:55.329053 24976 consensus_meta.cc:287] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.781s user 0.010s sys 0.004s
I20260807 13:40:55.436408 24976 raft_consensus.cc:504] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.437124 25027 leader_election.cc:288] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:55.439687 24976 leader_election.cc:288] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:55.386396 24956 raft_consensus.cc:504] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.442025 24960 leader_election.cc:288] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:55.395805 25078 consensus_queue.cc:260] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.396678 24860 raft_consensus.cc:504] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.387259 25017 raft_consensus.cc:504] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.386583 24719 raft_consensus.cc:504] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.403882 23600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 532) took 1314 ms. Trace:
I20260807 13:40:55.411118 25062 raft_consensus.cc:504] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:55.418998 23450 rpcz_store.cc:267] Call kudu.master.MasterService.IsCreateTableDone from 127.0.0.1:37978 (request call id 44) took 938 ms (client timeout 741 ms). Trace:
W20260807 13:40:55.337096 25044 consensus_meta.cc:287] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.670s user 0.000s sys 0.015s
I20260807 13:40:55.443305 23813 raft_consensus.cc:2379] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 4: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:55.464912 25044 raft_consensus.cc:2726] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:55.394862 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 336) took 1240 ms. Trace:
I20260807 13:40:55.444451 24956 leader_election.cc:288] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:55.452569 24853 raft_consensus.cc:482] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:55.409510 23814 raft_consensus.cc:2454] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:55.466003 23813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 363) took 1028 ms. Trace:
I20260807 13:40:55.467263 23704 rpcz_store.cc:276] 0807 13:40:54.147796 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:54.156960 (+ 9164us) service_pool.cc:227] Handling call
0807 13:40:55.170766 (+1013806us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b5800004598. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f4620fef1b0 00007f4620feea94 00007f461a6d6c04 00007f461a6d6b92
0807 13:40:55.388147 (+217381us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3396992}
I20260807 13:40:55.464046 23600 rpcz_store.cc:276] 0807 13:40:54.089721 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:54.436462 (+346741us) service_pool.cc:227] Handling call
0807 13:40:54.436827 (+ 365us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:54.466895 (+ 30068us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:54.466942 (+ 47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:54.491821 (+ 24879us) log.cc:842] Serialized 26 byte log entry
0807 13:40:55.185281 (+693460us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:40:55.216032 (+ 30751us) log.cc:842] Serialized 14 byte log entry
0807 13:40:55.216238 (+ 206us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:55.216309 (+ 71us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:55.394709 (+178400us) raft_consensus.cc:1671] finished
0807 13:40:55.394729 (+ 20us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:55.403793 (+ 9064us) inbound_call.cc:173] Queueing success response
0807 13:40:55.457554 (+ 53761us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b18000a39c0. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f46220248b1 00007f4622031661 00007f4619185638 00007f4619188b11 00007f4619188ac9 00007f4619188a59 00007f4619188a21 00007f4619187d1d 00007f46223e9204 00007f46223e9039 00007f4619167dc6
Metrics: {"mutex_wait_us":26187,"prepare.queue_time_us":30052,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":2454,"raft.queue_time_us":32093,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":6801,"spinlock_wait_cycles":4909824,"thread_start_us":641531,"threads_started":1,"wal-append.queue_time_us":884187}
W20260807 13:40:55.463732 23450 rpcz_store.cc:269] 0807 13:40:54.480660 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:54.480917 (+ 257us) service_pool.cc:227] Handling call
0807 13:40:54.481312 (+ 395us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0807 13:40:55.213890 (+732578us) catalog_manager.cc:2245] Verify if the table creation is in progress for test-workload [id=14f16c1129ee464da3f6afb00584355d]
0807 13:40:55.418421 (+204531us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":933973}
I20260807 13:40:55.469946 25063 leader_election.cc:288] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:55.472150 25017 leader_election.cc:288] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:55.474519 24860 leader_election.cc:288] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:55.478747 24719 leader_election.cc:288] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:55.408967 23590 rpcz_store.cc:276] 0807 13:40:54.140411 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:54.208252 (+ 67841us) service_pool.cc:227] Handling call
0807 13:40:55.204134 (+995882us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:55.458562 24745 leader_election.cc:288] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:55.460487 25038 leader_election.cc:288] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:55.462704 24583 consensus_queue.cc:260] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:55.495414 25074 log.cc:924] Time spent T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.449s user 0.004s sys 0.000s
I20260807 13:40:55.492146 24853 raft_consensus.cc:504] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.492486 23814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45360 (request call id 556) took 1149 ms. Trace:
I20260807 13:40:55.528472 23595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 542) took 1429 ms. Trace:
I20260807 13:40:55.492774 25078 raft_consensus.cc:3037] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:55.499333 23448 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37962 (request call id 138) took 2396 ms. Trace:
I20260807 13:40:55.529714 25002 leader_election.cc:288] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:55.529608 23448 rpcz_store.cc:276] 0807 13:40:53.103031 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:53.103290 (+ 259us) service_pool.cc:227] Handling call
0807 13:40:55.499264 (+2395974us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":53378,"reported_tablets":13}
I20260807 13:40:55.528601 23814 rpcz_store.cc:276] 0807 13:40:54.332889 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:54.334828 (+ 1939us) service_pool.cc:227] Handling call
0807 13:40:55.482398 (+1147570us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:55.529052 25062 leader_election.cc:288] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:55.475075 23813 rpcz_store.cc:276] 0807 13:40:54.437652 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:54.439408 (+ 1756us) service_pool.cc:227] Handling call
0807 13:40:55.465713 (+1026305us) spinlock_profiling.cc:243] Waited 975 ms on lock 0x7b54001f9854. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:40:55.465917 (+ 204us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2242407808}
I20260807 13:40:55.540324 24583 raft_consensus.cc:3037] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:55.528481 24853 leader_election.cc:288] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:55.572717 23769 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.014s user 0.041s sys 0.053s
W20260807 13:40:55.573220 23769 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.014s user 0.041s sys 0.053s
W20260807 13:40:55.573912 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 1.03343e+06us
I20260807 13:40:55.576117 23813 raft_consensus.cc:1226] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:55.577502 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:55.579329 25044 raft_consensus.cc:482] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:55.579406 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:55.579859 24853 raft_consensus.cc:482] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:55.580432 24605 raft_consensus.cc:482] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:55.580817 24853 raft_consensus.cc:504] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.581259 24605 raft_consensus.cc:504] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.586370 24853 leader_election.cc:288] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:55.588043 23813 raft_consensus.cc:1261] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:55.591732 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4062e0223a4cc0b2e448e35445671d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:55.588904 23818 raft_consensus.cc:1261] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:40:55.580026 25044 raft_consensus.cc:504] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.593233 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:55.593667 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:55.590847 23820 raft_consensus.cc:1226] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:55.590632 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:55.595594 25044 leader_election.cc:288] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:55.591485 24605 leader_election.cc:288] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:55.594625 23823 raft_consensus.cc:2379] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 4: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:55.597712 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:55.605029 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:55.606572 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:55.607412 23820 raft_consensus.cc:2454] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:55.608999 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:55.609555 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c1184114b02410098331e68d3b8d4cf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:55.610343 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:55.610605 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:55.611125 23821 raft_consensus.cc:3037] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:55.611430 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:55.612413 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:55.612951 23823 raft_consensus.cc:2454] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:55.613672 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:55.614208 23823 raft_consensus.cc:2454] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:55.608975 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:55.615064 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:55.615610 23820 raft_consensus.cc:2354] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
I20260807 13:40:55.616827 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:55.620275 23817 raft_consensus.cc:1261] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:55.622325 24853 raft_consensus.cc:482] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:55.623088 24853 raft_consensus.cc:504] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.627944 24853 leader_election.cc:288] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:55.615680 23825 raft_consensus.cc:2454] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:55.630326 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:55.631601 23818 raft_consensus.cc:2396] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:40:55.606490 23813 raft_consensus.cc:2396] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:40:55.650218 23821 raft_consensus.cc:2454] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:40:55.654456 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:55.655354 23823 raft_consensus.cc:2454] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
W20260807 13:40:55.660058 23711 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.726s user 0.013s sys 0.018s
W20260807 13:40:55.660473 23711 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.726s user 0.013s sys 0.018s
I20260807 13:40:55.671070 23660 leader_election.cc:302] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
W20260807 13:40:55.698246 23768 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.697s user 0.029s sys 0.047s
W20260807 13:40:55.698799 23768 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.715s user 0.029s sys 0.047s
I20260807 13:40:55.699784 24745 raft_consensus.cc:482] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:55.700444 24745 raft_consensus.cc:504] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.701867 25011 raft_consensus.cc:482] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:55.702557 25011 raft_consensus.cc:504] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.705619 25038 consensus_queue.cc:1046] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:55.706547 25038 raft_consensus.cc:3032] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:55.706861 25011 leader_election.cc:288] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:55.706931 25038 raft_consensus.cc:729] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:55.709645 23660 leader_election.cc:302] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:55.711557 23660 leader_election.cc:302] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:55.715134 24745 leader_election.cc:288] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:55.715565 25004 raft_consensus.cc:482] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:55.713975 25011 raft_consensus.cc:482] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:55.674613 24853 raft_consensus.cc:482] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:55.718238 23660 leader_election.cc:398] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Vote denied by peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685) with higher term. Message: Invalid argument: T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
I20260807 13:40:55.739500 23660 leader_election.cc:401] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260807 13:40:55.723420 24952 raft_consensus.cc:2781] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:40:55.726884 25063 consensus_queue.cc:1035] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:55.727660 24795 consensus_queue.cc:1046] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:55.728384 25017 consensus_queue.cc:1035] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:40:55.726578 23554 leader_election.cc:302] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:55.708225 24860 raft_consensus.cc:482] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:55.704046 25044 raft_consensus.cc:2781] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:55.731783 25000 raft_consensus.cc:2781] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:55.747059 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:55.754925 23818 raft_consensus.cc:2454] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:55.745199 23660 leader_election.cc:302] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
W20260807 13:40:55.742691 23594 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.702s user 0.000s sys 0.033s
W20260807 13:40:55.756539 23594 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s user 0.000s sys 0.033s
I20260807 13:40:55.529145 23595 rpcz_store.cc:276] 0807 13:40:54.099030 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:54.487298 (+388268us) service_pool.cc:227] Handling call
0807 13:40:54.487836 (+ 538us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:54.488252 (+ 416us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:54.488291 (+ 39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:54.532007 (+ 43716us) log.cc:842] Serialized 26 byte log entry
0807 13:40:54.899400 (+367393us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:40:54.916051 (+ 16651us) log.cc:842] Serialized 14 byte log entry
0807 13:40:54.916457 (+ 406us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:54.916586 (+ 129us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:55.451317 (+534731us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b480012c258. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4620f547f1 00007f4620f4b8e7 00007f4620f4b77a 00007f462103f95f 00007f462103f627 00007f4621053b2c 00007f4621053ad8 00007f4621053a58 00007f4621053a13 00007f4621052cbc 00007f461ffd4be6
0807 13:40:55.460838 (+ 9521us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b480012c258. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4620f547f1 00007f4620f4b8e7 00007f4620f4b77a 00007f462103f95f 00007f462103f627 00007f4621053b2c 00007f4621053ad8 00007f4621053a58 00007f4621053a13 00007f4621052cbc 00007f461ffd4be6
0807 13:40:55.490944 (+ 30106us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b44000232cc. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f4619097a95 00007f46190984b2 00007f461bd40511 00007f461bd3be1a 00007f461bd2fbee 00007f461bd2ef36 00007f461bd2eb58 00007f461bd38551 00007f461bd38509 00007f461bd38499
0807 13:40:55.528177 (+ 37233us) raft_consensus.cc:1671] finished
0807 13:40:55.528205 (+ 28us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:55.528385 (+ 180us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":24154,"prepare.run_cpu_time_us":1903,"prepare.run_wall_time_us":17062,"raft.queue_time_us":1039,"raft.run_cpu_time_us":6188,"raft.run_wall_time_us":1496651,"spinlock_wait_cycles":44153344,"thread_start_us":251943,"threads_started":1,"wal-append.queue_time_us":395902}
I20260807 13:40:55.759591 23595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 625) took 1608 ms. Trace:
I20260807 13:40:55.760047 23595 rpcz_store.cc:276] 0807 13:40:54.151399 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:55.758536 (+1607137us) service_pool.cc:227] Handling call
0807 13:40:55.758960 (+ 424us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:55.759165 (+ 205us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:55.759204 (+ 39us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:55.759247 (+ 43us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:55.759297 (+ 50us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:55.759377 (+ 80us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:55.759519 (+ 142us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:55.741088 24952 raft_consensus.cc:482] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:55.765057 23660 leader_election.cc:302] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
W20260807 13:40:55.766533 23772 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.831s user 0.004s sys 0.025s
W20260807 13:40:55.766949 23772 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.831s user 0.005s sys 0.025s
I20260807 13:40:55.744390 25046 raft_consensus.cc:3037] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:55.716173 25004 raft_consensus.cc:504] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.782473 23554 leader_election.cc:302] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:55.799357 23823 raft_consensus.cc:1226] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4. Ops: []
I20260807 13:40:55.756922 25002 raft_consensus.cc:482] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:55.798264 24795 consensus_queue.cc:1035] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.005s
W20260807 13:40:55.791076 23705 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.055s user 0.001s sys 0.037s
I20260807 13:40:55.803417 24719 raft_consensus.cc:482] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:55.806028 24888 raft_consensus.cc:2781] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:40:55.742035 24853 raft_consensus.cc:504] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.807010 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:55.808352 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:55.762319 25044 raft_consensus.cc:686] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:55.811636 23554 leader_election.cc:302] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:55.816009 24937 consensus_queue.cc:1046] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:40:55.762557 25062 raft_consensus.cc:3032] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:55.754742 25000 raft_consensus.cc:482] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:55.741562 25011 raft_consensus.cc:504] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.768306 24952 raft_consensus.cc:3037] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
W20260807 13:40:55.820746 23597 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.706s user 0.006s sys 0.023s
I20260807 13:40:55.766845 24999 raft_consensus.cc:2781] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:40:55.769382 24745 raft_consensus.cc:482] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:55.769480 24781 raft_consensus.cc:2781] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:55.769274 25088 raft_consensus.cc:2781] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:40:55.754359 24860 raft_consensus.cc:504] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.740531 25038 consensus_queue.cc:260] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.823577 24719 raft_consensus.cc:504] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:55.821672 23705 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.086s user 0.001s sys 0.037s
I20260807 13:40:55.821449 24888 raft_consensus.cc:482] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:40:55.884003 23597 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.769s user 0.007s sys 0.023s
W20260807 13:40:55.881256 23591 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.773s user 0.018s sys 0.031s
I20260807 13:40:55.821929 24956 raft_consensus.cc:482] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:55.893796 23595 raft_consensus.cc:1226] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:40:55.895262 24745 raft_consensus.cc:504] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.829773 25062 raft_consensus.cc:729] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:55.831660 25000 raft_consensus.cc:3037] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:55.831696 25017 raft_consensus.cc:2781] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:55.885689 24999 raft_consensus.cc:482] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:55.822928 25002 raft_consensus.cc:504] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:55.909857 23710 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.992s user 0.009s sys 0.025s
I20260807 13:40:55.886082 24781 raft_consensus.cc:482] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
W20260807 13:40:55.934580 23710 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.025s user 0.010s sys 0.025s
I20260807 13:40:55.899554 25088 raft_consensus.cc:686] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
W20260807 13:40:55.925992 23591 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.812s user 0.018s sys 0.032s
W20260807 13:40:55.939180 24739 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.814s user 0.013s sys 0.017s
W20260807 13:40:55.939618 24739 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.814s user 0.013s sys 0.017s
W20260807 13:40:55.940212 23662 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.377s user 0.013s sys 0.015s
W20260807 13:40:55.941002 23662 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.378s user 0.013s sys 0.016s
I20260807 13:40:55.906240 24888 raft_consensus.cc:3037] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
W20260807 13:40:55.901544 25025 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.706s user 0.014s sys 0.024s
W20260807 13:40:55.903851 25023 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s user 0.015s sys 0.031s
I20260807 13:40:55.903358 25063 raft_consensus.cc:482] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:55.932731 24795 raft_consensus.cc:482] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:55.947855 25088 consensus_queue.cc:237] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.952353 24795 raft_consensus.cc:504] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.953606 24860 leader_election.cc:288] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:55.938126 24781 raft_consensus.cc:3037] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:55.954766 24937 raft_consensus.cc:482] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:55.955261 24937 raft_consensus.cc:504] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.927852 25038 raft_consensus.cc:3037] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:55.954368 24795 leader_election.cc:288] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
PC: @ 0x0 (unknown)
I20260807 13:40:55.932941 25017 raft_consensus.cc:482] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
*** SIGABRT (@0x3e800005549) received by PID 21833 (TID 0x7f4614db7880) from PID 21833; stack trace: ***
@ 0x29bbc0 __tsan::CallUserSignalHandler() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:1915
@ 0x29e2b0 rtl_sigaction() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:2005
I20260807 13:40:55.934473 24956 raft_consensus.cc:504] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.937078 25044 consensus_queue.cc:237] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:55.937281 24999 raft_consensus.cc:3037] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:56.082928 23710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 356) took 1802 ms. Trace:
I20260807 13:40:55.956708 25011 leader_election.cc:288] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:40:56.194144 23601 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.879s user 0.005s sys 0.036s
I20260807 13:40:55.936962 25033 raft_consensus.cc:482] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:40:56.305634 23599 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.802s user 0.014s sys 0.010s
W20260807 13:40:56.106777 23598 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.774s user 0.018s sys 0.029s
W20260807 13:40:56.187502 23661 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.926s user 0.010s sys 0.020s
W20260807 13:40:56.325102 23555 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.627s user 0.017s sys 0.009s
W20260807 13:40:56.328488 23555 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.630s user 0.017s sys 0.009s
W20260807 13:40:56.328864 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 631080us
W20260807 13:40:56.331235 23598 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.999s user 0.022s sys 0.036s
W20260807 13:40:56.325932 23601 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.011s user 0.007s sys 0.038s
I20260807 13:40:55.965161 23595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 626) took 1805 ms. Trace:
W20260807 13:40:56.326292 23599 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.822s user 0.015s sys 0.010s
W20260807 13:40:55.957885 25023 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.715s user 0.015s sys 0.032s
W20260807 13:40:55.948894 25025 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.754s user 0.015s sys 0.024s
W20260807 13:40:56.068558 25060 log.cc:924] Time spent T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.124s user 0.000s sys 0.000s
I20260807 13:40:56.325683 23710 rpcz_store.cc:276] 0807 13:40:54.280240 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:54.525537 (+245297us) service_pool.cc:227] Handling call
0807 13:40:54.525994 (+ 457us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:54.542369 (+ 16375us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:54.542398 (+ 29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:54.542960 (+ 562us) log.cc:842] Serialized 26 byte log entry
0807 13:40:54.899129 (+356169us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:40:55.935241 (+1036112us) log.cc:842] Serialized 14 byte log entry
0807 13:40:56.082483 (+147242us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:56.082569 (+ 86us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:56.082612 (+ 43us) raft_consensus.cc:1671] finished
0807 13:40:56.082623 (+ 11us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:56.082846 (+ 223us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":182732,"prepare.queue_time_us":112764,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":180204,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":304,"thread_start_us":1337924,"threads_started":2,"wal-append.queue_time_us":428877}
W20260807 13:40:56.326568 23661 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.402s user 0.011s sys 0.029s
I20260807 13:40:56.004413 24719 leader_election.cc:288] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:56.230930 24905 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.808s user 0.003s sys 0.036s
I20260807 13:40:56.009840 24853 leader_election.cc:288] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:56.305851 24977 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.012s user 0.019s sys 0.023s
W20260807 13:40:56.103976 23815 consensus_meta.cc:287] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.680s user 0.014s sys 0.001s
W20260807 13:40:56.345296 23703 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.028s user 0.014s sys 0.047s
I20260807 13:40:56.326977 24982 raft_consensus.cc:482] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:40:56.371145 23703 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.054s user 0.014s sys 0.047s
W20260807 13:40:56.100540 23588 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.185s user 0.023s sys 0.020s
W20260807 13:40:56.385007 23711 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s user 0.035s sys 0.027s
W20260807 13:40:56.385941 23711 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s user 0.036s sys 0.027s
I20260807 13:40:56.344180 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 354) took 2062 ms. Trace:
I20260807 13:40:56.320214 25017 raft_consensus.cc:3037] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:55.994942 24745 leader_election.cc:288] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:56.201612 25004 leader_election.cc:288] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:56.407827 25015 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.942s user 0.017s sys 0.031s
I20260807 13:40:55.965658 25092 raft_consensus.cc:482] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:56.093647 23705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 350) took 1862 ms. Trace:
I20260807 13:40:56.058696 24605 raft_consensus.cc:482] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:56.385159 23815 raft_consensus.cc:2454] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
W20260807 13:40:56.363240 25032 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.838s user 0.026s sys 0.002s
I20260807 13:40:56.291368 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:55.968518 25002 leader_election.cc:288] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:56.328999 24941 raft_consensus.cc:482] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:56.429507 25103 raft_consensus.cc:482] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:40:56.368625 24905 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.980s user 0.003s sys 0.040s
W20260807 13:40:56.370412 24977 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.084s user 0.020s sys 0.024s
I20260807 13:40:56.084015 24781 raft_consensus.cc:504] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:56.347023 23600 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s user 0.012s sys 0.009s
W20260807 13:40:56.480923 23600 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.823s user 0.012s sys 0.009s
I20260807 13:40:55.962925 25063 raft_consensus.cc:504] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:56.365620 24937 leader_election.cc:288] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:56.385464 23588 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.470s user 0.025s sys 0.031s
I20260807 13:40:56.364030 25080 raft_consensus.cc:3032] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:40:56.372757 25023 raft_consensus.cc:482] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:56.332976 25033 raft_consensus.cc:504] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:56.420204 23825 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s user 0.006s sys 0.025s
I20260807 13:40:56.084975 24860 raft_consensus.cc:482] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:56.368202 23812 raft_consensus.cc:2454] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:56.068046 25062 consensus_queue.cc:260] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:56.292098 25046 consensus_meta.cc:287] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.501s user 0.013s sys 0.000s
W20260807 13:40:56.212931 24859 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.979s user 0.024s sys 0.005s
W20260807 13:40:56.443271 25015 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.977s user 0.017s sys 0.031s
I20260807 13:40:56.390785 24982 raft_consensus.cc:504] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:56.342681 23595 rpcz_store.cc:276] 0807 13:40:54.157271 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:55.761212 (+1603941us) service_pool.cc:227] Handling call
0807 13:40:55.761582 (+ 370us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:55.934118 (+172536us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:55.956675 (+ 22557us) spinlock_profiling.cc:243] Waited 70.6 ms on lock 0x7b5400253fd4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:40:55.962233 (+ 5558us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":162301696}
W20260807 13:40:56.486392 23823 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s user 0.002s sys 0.020s
W20260807 13:40:56.451375 25032 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.925s user 0.026s sys 0.003s
W20260807 13:40:56.503623 23825 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.771s user 0.007s sys 0.026s
W20260807 13:40:56.523578 23823 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s user 0.002s sys 0.021s
W20260807 13:40:56.484651 23815 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45360 (request call id 548) took 2288 ms (client timeout 2068 ms). Trace:
I20260807 13:40:56.449182 24605 raft_consensus.cc:504] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:56.499544 25103 raft_consensus.cc:504] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
I20260807 13:40:56.486967 24941 raft_consensus.cc:504] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:56.499349 25080 raft_consensus.cc:729] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
W20260807 13:40:56.524739 24859 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.293s user 0.024s sys 0.010s
I20260807 13:40:56.450207 25092 raft_consensus.cc:504] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:56.514014 24860 raft_consensus.cc:504] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:56.504833 23813 raft_consensus.cc:2454] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:56.528553 25046 raft_consensus.cc:2726] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685) with higher term. Message: Invalid argument: T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
W20260807 13:40:56.505004 23558 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.610s user 0.008s sys 0.015s
W20260807 13:40:56.548806 25104 log.cc:924] Time spent T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.273s user 0.000s sys 0.001s
I20260807 13:40:56.636320 25015 raft_consensus.cc:482] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:56.637028 23595 raft_consensus.cc:1261] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:40:56.636904 25015 raft_consensus.cc:504] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:56.583258 25106 log.cc:924] Time spent T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.297s user 0.000s sys 0.001s
W20260807 13:40:56.638820 25129 log.cc:924] Time spent T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.125s user 0.001s sys 0.000s
I20260807 13:40:56.639403 23595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 628) took 2456 ms. Trace:
I20260807 13:40:56.550328 24956 leader_election.cc:288] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:56.510314 23814 raft_consensus.cc:1226] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 2. Current term is 3. Ops: []
W20260807 13:40:56.589555 23558 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.694s user 0.009s sys 0.015s
W20260807 13:40:56.587824 24888 consensus_meta.cc:287] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent flushing consensus metadata: real 0.625s user 0.010s sys 0.002s
I20260807 13:40:56.664862 24888 raft_consensus.cc:504] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:56.676905 24952 consensus_meta.cc:287] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.783s user 0.005s sys 0.006s
I20260807 13:40:56.677397 24952 raft_consensus.cc:504] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:56.679358 24781 leader_election.cc:288] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:56.670917 25080 consensus_queue.cc:260] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:56.681059 25080 raft_consensus.cc:3037] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:56.511750 25023 raft_consensus.cc:504] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:56.686013 23772 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.907s user 0.017s sys 0.040s
W20260807 13:40:56.716032 23597 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.774s user 0.017s sys 0.040s
W20260807 13:40:56.745994 23597 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.804s user 0.017s sys 0.040s
W20260807 13:40:56.688704 25123 log.cc:924] Time spent T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.100s user 0.000s sys 0.001s
W20260807 13:40:56.715494 25108 log.cc:924] Time spent T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.235s user 0.001s sys 0.001s
W20260807 13:40:56.747877 23594 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.990s user 0.014s sys 0.041s
W20260807 13:40:56.713161 25088 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.758s user 0.017s sys 0.061s
W20260807 13:40:56.745486 23772 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.966s user 0.019s sys 0.042s
W20260807 13:40:56.744861 25128 log.cc:924] Time spent T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.155s user 0.000s sys 0.001s
W20260807 13:40:56.542742 23815 rpcz_store.cc:269] 0807 13:40:54.163411 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:54.164708 (+ 1297us) service_pool.cc:227] Handling call
0807 13:40:55.272962 (+1108254us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b5800255098. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914dbce 000000000034aea9 00007f4620f79a30 00007f462103f7b4 00007f462103f821 00007f4620fef1b0 00007f4620feea94 00007f461a6d6c04 00007f461a6d6b92
0807 13:40:56.451312 (+1178350us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6069504}
W20260807 13:40:56.871520 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 1.10335e+06us
W20260807 13:40:56.870514 23594 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.112s user 0.014s sys 0.041s
I20260807 13:40:56.868786 23597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 615) took 2606 ms. Trace:
I20260807 13:40:56.715637 24781 raft_consensus.cc:482] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:40:56.879276 23555 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.525s user 0.028s sys 0.036s
W20260807 13:40:56.893215 23555 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.539s user 0.028s sys 0.036s
I20260807 13:40:56.884832 23597 rpcz_store.cc:276] 0807 13:40:54.141228 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:55.082482 (+941254us) service_pool.cc:227] Handling call
0807 13:40:55.091065 (+ 8583us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:55.091415 (+ 350us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:55.091461 (+ 46us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:55.114244 (+ 22783us) log.cc:842] Serialized 26 byte log entry
0807 13:40:55.905170 (+790926us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:56.746420 (+841250us) log.cc:842] Serialized 14 byte log entry
0807 13:40:56.747103 (+ 683us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:56.747179 (+ 76us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:56.747227 (+ 48us) raft_consensus.cc:1671] finished
0807 13:40:56.747242 (+ 15us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:56.747428 (+ 186us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":446,"raft.run_cpu_time_us":395,"raft.run_wall_time_us":128433,"thread_start_us":1594562,"threads_started":2,"wal-append.queue_time_us":1119158}
W20260807 13:40:56.895062 23556 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.633s user 0.007s sys 0.020s
W20260807 13:40:56.895349 25120 log.cc:924] Time spent T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.228s user 0.000s sys 0.000s
W20260807 13:40:56.895565 23556 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.950s user 0.007s sys 0.020s
I20260807 13:40:56.395371 23699 rpcz_store.cc:276] 0807 13:40:54.279420 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:54.531798 (+252378us) service_pool.cc:227] Handling call
0807 13:40:54.544728 (+ 12930us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:54.586639 (+ 41911us) raft_consensus.cc:1520] Early marking committed up to index 1
0807 13:40:54.923665 (+337026us) log.cc:842] Serialized 14 byte log entry
0807 13:40:55.233983 (+310318us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:55.234818 (+ 835us) log.cc:842] Serialized 26 byte log entry
0807 13:40:55.235080 (+ 262us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:40:55.236114 (+ 1034us) log.cc:842] Serialized 14 byte log entry
0807 13:40:55.237099 (+ 985us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:55.237221 (+ 122us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:55.241459 (+ 4238us) spinlock_profiling.cc:243] Waited 6.98 ms on lock 0x7b18002e5ac0. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f46220248b1 00007f4622031661 00007f4619185764 00007f4619188b11 00007f4619188ac9 00007f4619188a59 00007f4619188a21 00007f4619187d1d 00007f46223e9204 00007f46223e9039 00007f4619167dc6
0807 13:40:55.254364 (+ 12905us) spinlock_profiling.cc:243] Waited 5.1 ms on lock 0x7b18002e5ac0. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f46220248b1 00007f4622031661 00007f4619185638 00007f4619188b11 00007f4619188ac9 00007f4619188a59 00007f4619188a21 00007f4619187d1d 00007f46223e9204 00007f46223e9039 00007f4619167dc6
0807 13:40:55.334910 (+ 80546us) spinlock_profiling.cc:243] Waited 7.1 ms on lock 0x7b18002e5ac0. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f46220248b1 00007f4622031661 00007f4619185638 00007f4619188b11 00007f4619188ac9 00007f4619188a59 00007f4619188a21 00007f4619187d1d 00007f46223e9204 00007f46223e9039 00007f4619167dc6
0807 13:40:55.336538 (+ 1628us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b18002e5ac0. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f46220248b1 00007f4622031661 00007f4619185799 00007f4619188b11 00007f4619188ac9 00007f4619188a59 00007f4619188a21 00007f4619187d1d 00007f46223e9204 00007f46223e9039 00007f4619167dc6
0807 13:40:56.307306 (+970768us) raft_consensus.cc:1671] finished
0807 13:40:56.320222 (+ 12916us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:56.341271 (+ 21049us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":54183,"prepare.queue_time_us":383579,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":105,"raft.queue_time_us":63971,"raft.run_cpu_time_us":596,"raft.run_wall_time_us":31606,"spinlock_wait_cycles":50398976,"thread_start_us":477841,"threads_started":2,"wal-append.queue_time_us":725014}
W20260807 13:40:56.897289 25000 consensus_meta.cc:287] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.952s user 0.009s sys 0.004s
I20260807 13:40:56.880856 25063 leader_election.cc:288] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:56.903906 25124 log.cc:924] Time spent T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.200s user 0.000s sys 0.000s
W20260807 13:40:56.906764 25109 log.cc:924] Time spent T d82ae8b5e643448f937e62d82bf888ff P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.465s user 0.000s sys 0.001s
W20260807 13:40:56.908613 25122 log.cc:924] Time spent T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.181s user 0.000s sys 0.000s
W20260807 13:40:56.910573 25113 log.cc:924] Time spent T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.224s user 0.000s sys 0.000s
W20260807 13:40:56.914009 25115 log.cc:924] Time spent T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.266s user 0.000s sys 0.000s
W20260807 13:40:56.915215 25110 log.cc:924] Time spent T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.414s user 0.000s sys 0.001s
I20260807 13:40:56.920680 23823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45370 (request call id 391) took 1089 ms. Trace:
I20260807 13:40:56.921067 23823 rpcz_store.cc:276] 0807 13:40:55.831060 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:55.831167 (+ 107us) service_pool.cc:227] Handling call
0807 13:40:55.904000 (+ 72833us) spinlock_profiling.cc:243] Waited 9.07 ms on lock 0x7b5800255098. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f46210032b0 00007f4620fee7f9 00007f4620fee2a2 00007f461a6d4684
0807 13:40:55.904203 (+ 203us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:55.904422 (+ 219us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:55.904445 (+ 23us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:55.927400 (+ 22955us) log.cc:842] Serialized 26 byte log entry
0807 13:40:56.543856 (+616456us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:56.543935 (+ 79us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:56.544546 (+ 611us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:56.920348 (+375802us) raft_consensus.cc:1671] finished
0807 13:40:56.920372 (+ 24us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:56.920616 (+ 244us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":20854656,"thread_start_us":595821,"threads_started":1,"wal-append.queue_time_us":924856}
I20260807 13:40:56.922833 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:56.923454 23823 raft_consensus.cc:2454] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:56.924338 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:56.924600 25023 leader_election.cc:288] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:56.925034 23823 raft_consensus.cc:2379] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:56.925989 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:56.751791 25002 raft_consensus.cc:482] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:56.926586 23823 raft_consensus.cc:2454] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:56.927035 25002 raft_consensus.cc:504] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:56.447010 23705 rpcz_store.cc:276] 0807 13:40:54.231148 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:54.287544 (+ 56396us) service_pool.cc:227] Handling call
0807 13:40:54.288074 (+ 530us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:54.288675 (+ 601us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:54.288730 (+ 55us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:54.289556 (+ 826us) log.cc:842] Serialized 26 byte log entry
0807 13:40:54.597023 (+307467us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:40:55.916872 (+1319849us) log.cc:842] Serialized 14 byte log entry
0807 13:40:55.951915 (+ 35043us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:55.963124 (+ 11209us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:55.978537 (+ 15413us) raft_consensus.cc:1671] finished
0807 13:40:56.039391 (+ 60854us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:56.086423 (+ 47032us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":45488,"prepare.queue_time_us":382678,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":21078,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":17313,"thread_start_us":1456947,"threads_started":2,"wal-append.queue_time_us":631122}
I20260807 13:40:56.930068 23823 raft_consensus.cc:1226] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4. Ops: []
W20260807 13:40:56.931500 25117 log.cc:924] Time spent T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.055s user 0.000s sys 0.000s
W20260807 13:40:56.877470 25088 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.923s user 0.019s sys 0.061s
I20260807 13:40:56.934357 23594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 614) took 2793 ms. Trace:
I20260807 13:40:56.935168 24795 raft_consensus.cc:482] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:56.936759 24795 raft_consensus.cc:504] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:56.938184 24999 consensus_meta.cc:287] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent flushing consensus metadata: real 0.575s user 0.009s sys 0.000s
I20260807 13:40:56.935905 25025 raft_consensus.cc:482] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:56.934742 23594 rpcz_store.cc:276] 0807 13:40:54.140953 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:55.038741 (+897788us) service_pool.cc:227] Handling call
0807 13:40:55.039237 (+ 496us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:55.039626 (+ 389us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:55.039669 (+ 43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:55.040215 (+ 546us) log.cc:842] Serialized 26 byte log entry
0807 13:40:55.757701 (+717486us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:40:56.884552 (+1126851us) log.cc:842] Serialized 14 byte log entry
0807 13:40:56.934059 (+ 49507us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:56.934128 (+ 69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:56.934167 (+ 39us) raft_consensus.cc:1671] finished
0807 13:40:56.934177 (+ 10us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:56.934302 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":49208,"raft.queue_time_us":51237,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":275,"thread_start_us":1843407,"threads_started":2,"wal-append.queue_time_us":926294}
I20260807 13:40:56.939260 25025 raft_consensus.cc:504] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:56.939810 25092 leader_election.cc:288] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:56.940749 23594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 632) took 2279 ms. Trace:
I20260807 13:40:56.941190 25025 leader_election.cc:288] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:56.935382 25134 raft_consensus.cc:482] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:56.942437 24795 leader_election.cc:288] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:56.942263 25134 raft_consensus.cc:504] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:56.639782 23595 rpcz_store.cc:276] 0807 13:40:54.182603 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:56.592853 (+2410250us) service_pool.cc:227] Handling call
0807 13:40:56.636652 (+ 43799us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:56.639093 (+ 2441us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:56.639338 (+ 245us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:56.944373 25134 leader_election.cc:288] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:56.945022 23825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45360 (request call id 558) took 1344 ms. Trace:
I20260807 13:40:56.945511 23825 rpcz_store.cc:276] 0807 13:40:55.601110 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:55.662831 (+ 61721us) service_pool.cc:227] Handling call
0807 13:40:55.663301 (+ 470us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:55.663577 (+ 276us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:55.663613 (+ 36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:55.666049 (+ 2436us) log.cc:842] Serialized 26 byte log entry
0807 13:40:56.527141 (+861092us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:56.527190 (+ 49us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:56.527259 (+ 69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:56.944808 (+417549us) raft_consensus.cc:1671] finished
0807 13:40:56.944828 (+ 20us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:56.944964 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":794139,"threads_started":1,"wal-append.queue_time_us":1055357}
I20260807 13:40:56.946355 24860 leader_election.cc:288] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:56.948098 24605 leader_election.cc:288] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:56.948705 25104 log.cc:924] Time spent T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.081s user 0.000s sys 0.000s
I20260807 13:40:56.951738 25015 leader_election.cc:288] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:56.952668 24952 leader_election.cc:288] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:56.953490 24719 raft_consensus.cc:482] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:56.953783 25033 leader_election.cc:288] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:56.955828 25038 consensus_meta.cc:287] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent flushing consensus metadata: real 0.982s user 0.012s sys 0.000s
I20260807 13:40:56.747551 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:56.959115 23813 raft_consensus.cc:2454] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
W20260807 13:40:56.960150 23541 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da: Tablet 1f8a5f186bf1473a988921e5efa3e574 (table test-workload [id=14f16c1129ee464da3f6afb00584355d]) was not created within the allowed timeout. Replacing with a new tablet 7a180725c9e34d0095ab423614678d88
I20260807 13:40:56.941085 23594 rpcz_store.cc:276] 0807 13:40:54.661622 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:56.939972 (+2278350us) service_pool.cc:227] Handling call
0807 13:40:56.940277 (+ 305us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:56.940456 (+ 179us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:56.940480 (+ 24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:56.940516 (+ 36us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:56.940545 (+ 29us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:56.940590 (+ 45us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:56.940688 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:56.879190 25070 raft_consensus.cc:482] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:56.897847 25000 raft_consensus.cc:504] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:56.944931 23595 raft_consensus.cc:1261] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260807 13:40:56.889670 23772 connection.cc:232] RPC call timeout handler was delayed by -1.764928791904822s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1781s for a response
I20260807 13:40:56.972298 23594 raft_consensus.cc:1261] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260807 13:40:56.972745 23594 pending_rounds.cc:76] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812: Aborting all ops after (but not including) 1
I20260807 13:40:56.973014 23594 pending_rounds.cc:97] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260807 13:40:56.973379 23594 raft_consensus.cc:2866] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:40:56.974088 23594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 635) took 2311 ms. Trace:
I20260807 13:40:56.954144 24719 raft_consensus.cc:504] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:56.985590 23597 raft_consensus.cc:1226] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 3. Current term is 4. Ops: []
I20260807 13:40:56.986349 23597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 630) took 2751 ms. Trace:
I20260807 13:40:56.987066 23597 rpcz_store.cc:276] 0807 13:40:54.235186 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:56.966052 (+2730866us) service_pool.cc:227] Handling call
0807 13:40:56.985368 (+ 19316us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:56.986080 (+ 712us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:56.986290 (+ 210us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:56.980654 25002 leader_election.cc:288] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:56.936115 25137 raft_consensus.cc:482] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
W20260807 13:40:56.967249 23591 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.873s user 0.037s sys 0.060s
I20260807 13:40:56.974395 23594 rpcz_store.cc:276] 0807 13:40:54.662542 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:56.964246 (+2301704us) service_pool.cc:227] Handling call
0807 13:40:56.969390 (+ 5144us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:56.973865 (+ 4475us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:56.974040 (+ 175us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:56.970424 24888 leader_election.cc:288] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:56.990336 23662 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.810s user 0.004s sys 0.009s
W20260807 13:40:56.994100 23703 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.502s user 0.002s sys 0.010s
W20260807 13:40:56.990669 23598 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.614s user 0.029s sys 0.060s
W20260807 13:40:56.992528 23599 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.560s user 0.000s sys 0.011s
W20260807 13:40:56.994948 23599 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.563s user 0.000s sys 0.011s
W20260807 13:40:56.994278 23662 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.814s user 0.004s sys 0.009s
W20260807 13:40:56.995915 23660 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.659s user 0.000s sys 0.011s
W20260807 13:40:56.996325 23660 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.660s user 0.000s sys 0.012s
W20260807 13:40:56.996665 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 668580us
W20260807 13:40:56.994575 23598 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.618s user 0.029s sys 0.060s
I20260807 13:40:57.003049 23598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 533) took 2913 ms. Trace:
W20260807 13:40:56.991391 25139 log.cc:924] Time spent T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.061s user 0.000s sys 0.001s
I20260807 13:40:56.984249 24982 leader_election.cc:288] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:40:56.992566 23591 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.908s user 0.037s sys 0.060s
W20260807 13:40:57.007822 23769 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.582s user 0.000s sys 0.012s
W20260807 13:40:57.008213 23769 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.582s user 0.000s sys 0.012s
W20260807 13:40:57.008579 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 616393us
I20260807 13:40:57.010425 23554 leader_election.cc:302] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:57.011693 23600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 621) took 2868 ms. Trace:
I20260807 13:40:57.012207 23600 rpcz_store.cc:276] 0807 13:40:54.143719 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:55.504670 (+1360951us) service_pool.cc:227] Handling call
0807 13:40:55.538382 (+ 33712us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:55.538857 (+ 475us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:55.538893 (+ 36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:55.540797 (+ 1904us) log.cc:842] Serialized 26 byte log entry
0807 13:40:56.481364 (+940567us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:57.010995 (+529631us) log.cc:842] Serialized 14 byte log entry
0807 13:40:57.011309 (+ 314us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:57.011405 (+ 96us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:57.011457 (+ 52us) raft_consensus.cc:1671] finished
0807 13:40:57.011474 (+ 17us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:57.011624 (+ 150us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":822,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":3562,"thread_start_us":1315645,"threads_started":2,"wal-append.queue_time_us":996494}
I20260807 13:40:57.003490 23598 rpcz_store.cc:276] 0807 13:40:54.089993 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:55.208429 (+1118436us) service_pool.cc:227] Handling call
0807 13:40:55.214006 (+ 5577us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:55.214426 (+ 420us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:55.214463 (+ 37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:55.215024 (+ 561us) log.cc:842] Serialized 26 byte log entry
0807 13:40:55.332272 (+117248us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b180033cac0. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f46220248b1 00007f4622031661 00007f4619167345 00007f4621f9ea39 00007f46191848bb 00007f4619182cbf 00007f4619184e22 00007f461bd2e5bb 00007f461bd34063 00007f461bd34411 00007f461c0815cf
0807 13:40:56.331833 (+999561us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:40:57.002405 (+670572us) log.cc:842] Serialized 14 byte log entry
0807 13:40:57.002634 (+ 229us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:57.002738 (+ 104us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:57.002777 (+ 39us) raft_consensus.cc:1671] finished
0807 13:40:57.002857 (+ 80us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:57.002990 (+ 133us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1695,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":5383,"spinlock_wait_cycles":5499136,"thread_start_us":1624994,"threads_started":2,"wal-append.queue_time_us":1452459}
W20260807 13:40:57.027861 23818 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.936s user 0.000s sys 0.014s
W20260807 13:40:57.028332 23818 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.937s user 0.000s sys 0.014s
I20260807 13:40:57.030440 23662 leader_election.cc:398] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187) with higher term. Message: Invalid argument: T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
W20260807 13:40:57.031450 23601 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.614s user 0.005s sys 0.009s
I20260807 13:40:56.965210 24781 raft_consensus.cc:504] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:57.031865 23601 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.615s user 0.005s sys 0.009s
W20260807 13:40:56.994431 23703 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.503s user 0.002s sys 0.010s
I20260807 13:40:57.032989 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 362) took 2405 ms. Trace:
I20260807 13:40:57.030781 23662 leader_election.cc:401] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:40:56.966457 24999 raft_consensus.cc:504] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:57.003362 25007 raft_consensus.cc:482] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:56.975306 25070 raft_consensus.cc:504] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:56.994549 25137 raft_consensus.cc:504] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
@ 0x7f461c4b2980 (unknown) at ??:0
W20260807 13:40:57.180380 23711 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.791s user 0.047s sys 0.109s
W20260807 13:40:57.184521 23711 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.798s user 0.047s sys 0.110s
I20260807 13:40:57.134357 23601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 528) took 3047 ms. Trace:
I20260807 13:40:57.041260 23554 leader_election.cc:302] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
W20260807 13:40:57.097529 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 99755.2us
I20260807 13:40:57.132169 25103 leader_election.cc:288] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685), 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187)
W20260807 13:40:57.067921 23661 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.577s user 0.007s sys 0.017s
W20260807 13:40:57.186728 23661 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.695s user 0.007s sys 0.031s
I20260807 13:40:57.186590 23662 leader_election.cc:302] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
W20260807 13:40:57.092397 23821 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.984s user 0.013s sys 0.021s
W20260807 13:40:57.187435 23821 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.079s user 0.018s sys 0.022s
I20260807 13:40:57.036049 25004 raft_consensus.cc:2781] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:57.187786 25004 raft_consensus.cc:482] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:57.188230 25004 raft_consensus.cc:3037] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:57.184945 23601 rpcz_store.cc:276] 0807 13:40:54.080417 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:54.358068 (+277651us) service_pool.cc:227] Handling call
0807 13:40:54.413131 (+ 55063us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:54.564636 (+151505us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:54.564670 (+ 34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:55.314372 (+749702us) spinlock_profiling.cc:243] Waited 30.1 ms on lock 0x7b2c0000b238. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461aa90e11 00007f461aaa0442 00007f461c0e8c11 00007f461c0ad58a 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772
0807 13:40:55.314873 (+ 501us) log.cc:842] Serialized 26 byte log entry
0807 13:40:56.333173 (+1018300us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:40:57.032290 (+699117us) log.cc:842] Serialized 14 byte log entry
0807 13:40:57.041546 (+ 9256us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:57.041620 (+ 74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:57.041665 (+ 45us) raft_consensus.cc:1671] finished
0807 13:40:57.127664 (+ 85999us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:57.127940 (+ 276us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":78195,"prepare.queue_time_us":833024,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":48881,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":37884,"spinlock_wait_cycles":69308672,"thread_start_us":1778062,"threads_started":3,"wal-append.queue_time_us":1368037}
I20260807 13:40:57.092422 24860 raft_consensus.cc:482] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
W20260807 13:40:57.197083 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 155914us
I20260807 13:40:57.181339 24982 raft_consensus.cc:482] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
W20260807 13:40:57.098973 25117 log.cc:924] Time spent T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.063s user 0.001s sys 0.000s
W20260807 13:40:57.139523 25124 log.cc:924] Time spent T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.093s user 0.000s sys 0.000s
W20260807 13:40:57.097949 25123 log.cc:924] Time spent T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.088s user 0.000s sys 0.000s
W20260807 13:40:57.110742 23820 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.764s user 0.019s sys 0.069s
W20260807 13:40:57.233726 23820 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.888s user 0.020s sys 0.070s
I20260807 13:40:57.033404 23703 rpcz_store.cc:276] 0807 13:40:54.627804 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:55.139352 (+511548us) service_pool.cc:227] Handling call
0807 13:40:55.139737 (+ 385us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:40:55.175012 (+ 35275us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:55.175061 (+ 49us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:40:55.276611 (+101550us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b18002abda0. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f46220248b1 00007f4622031661 00007f4619152f96 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461aa90e11 00007f461aaa0442 00007f461c0e8c11 00007f461c0ad58a
0807 13:40:55.278174 (+ 1563us) spinlock_profiling.cc:243] Waited 9.55 ms on lock 0x7b2c00005cf8. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461aa90e11 00007f461aaa0442 00007f461c0e8c11 00007f461c0ad58a 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772
0807 13:40:55.296962 (+ 18788us) log.cc:842] Serialized 52 byte log entry
0807 13:40:56.371813 (+1074851us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:40:56.402929 (+ 31116us) log.cc:842] Serialized 14 byte log entry
0807 13:40:56.490986 (+ 88057us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b18002abda0. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f46220248b1 00007f4622031661 00007f46190fc4ca 00007f46227ddf99 00007f4618fc0990 00007f4619182864 00007f4619182155 00007f461c0a53d0 00007f461c0b7576 00007f461c0c80d7 00007f461c0c8058
0807 13:40:56.491453 (+ 467us) log.cc:842] Serialized 14 byte log entry
0807 13:40:57.032562 (+541109us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:57.032670 (+ 108us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:57.032713 (+ 43us) raft_consensus.cc:1671] finished
0807 13:40:57.032738 (+ 25us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:57.032915 (+ 177us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13899,"prepare.queue_time_us":50645,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":2455,"raft.queue_time_us":152266,"raft.run_cpu_time_us":597,"raft.run_wall_time_us":46659,"spinlock_wait_cycles":85551872,"thread_start_us":1595604,"threads_started":2,"wal-append.queue_time_us":1273937}
I20260807 13:40:56.997051 23595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 633) took 2333 ms. Trace:
I20260807 13:40:57.031183 24952 raft_consensus.cc:482] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:57.143436 24905 raft_consensus.cc:482] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:40:57.256817 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 70311.8us
I20260807 13:40:57.244189 23554 leader_election.cc:302] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:57.134752 25098 raft_consensus.cc:2726] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187) with higher term. Message: Invalid argument: T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
W20260807 13:40:57.010737 23590 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.998s user 0.004s sys 0.010s
W20260807 13:40:57.244808 23660 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.82.67:46685 timed out after 2.246s (SENT) [suppressed 26 similar messages]
I20260807 13:40:57.153328 23591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 616) took 3007 ms. Trace:
I20260807 13:40:57.040243 25015 raft_consensus.cc:482] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:57.141275 24956 raft_consensus.cc:482] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:57.197091 25033 raft_consensus.cc:482] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:57.199885 25171 raft_consensus.cc:482] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
W20260807 13:40:57.277551 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 70305.9us
I20260807 13:40:57.195896 25000 leader_election.cc:288] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:57.277578 23662 leader_election.cc:302] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:57.194144 24860 raft_consensus.cc:504] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:57.350239 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:57.284752 23554 leader_election.cc:302] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:57.046522 24941 leader_election.cc:288] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:57.350768 23710 raft_consensus.cc:2454] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
W20260807 13:40:57.277845 23590 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.265s user 0.004s sys 0.014s
I20260807 13:40:57.354971 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:57.355199 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:57.278035 25125 log.cc:924] Time spent T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.073s user 0.000s sys 0.001s
I20260807 13:40:57.244643 25002 raft_consensus.cc:2781] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:40:57.244166 25155 raft_consensus.cc:482] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:57.279146 25078 consensus_queue.cc:1046] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
I20260807 13:40:57.277979 25092 raft_consensus.cc:482] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:57.278298 25044 raft_consensus.cc:2726] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:40:57.345693 25088 raft_consensus.cc:482] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:57.351533 24860 leader_election.cc:288] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:57.130558 25063 raft_consensus.cc:482] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:57.355809 23702 raft_consensus.cc:2454] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:57.359783 25025 raft_consensus.cc:482] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:57.356841 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:57.358556 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:57.403542 23707 raft_consensus.cc:3037] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:57.282182 24853 raft_consensus.cc:2781] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:40:57.243224 24982 raft_consensus.cc:504] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:57.243961 25007 raft_consensus.cc:504] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:57.335593 25023 raft_consensus.cc:482] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:57.289078 24956 raft_consensus.cc:504] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:57.383126 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:57.403676 23704 raft_consensus.cc:2454] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:57.365175 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:57.427124 23601 raft_consensus.cc:2379] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:57.383878 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:57.427852 23597 raft_consensus.cc:3037] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:57.367193 23598 raft_consensus.cc:1226] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260807 13:40:57.354637 25143 raft_consensus.cc:482] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:57.363548 24795 raft_consensus.cc:482] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:57.359618 23588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 538) took 3262 ms. Trace:
I20260807 13:40:57.345602 25098 raft_consensus.cc:482] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:57.386898 23700 raft_consensus.cc:1261] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:40:57.359700 25158 raft_consensus.cc:482] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:57.387413 23599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 618) took 3245 ms. Trace:
I20260807 13:40:57.394718 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:57.362697 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:57.392340 25078 raft_consensus.cc:3032] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:40:57.392771 24941 raft_consensus.cc:3037] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:57.393476 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:57.481442 23600 raft_consensus.cc:3037] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:57.279371 24952 raft_consensus.cc:504] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:57.352963 23710 raft_consensus.cc:1261] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:40:57.477954 23711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 652) took 3226 ms. Trace:
I20260807 13:40:57.483315 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f8a5f186bf1473a988921e5efa3e574" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:57.400876 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:57.356568 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:57.284380 24905 raft_consensus.cc:504] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:57.203526 24739 raft_consensus.cc:482] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:57.286214 25015 raft_consensus.cc:504] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:57.336160 25033 raft_consensus.cc:504] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:57.428386 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:57.406865 25063 raft_consensus.cc:504] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:57.426298 25025 raft_consensus.cc:504] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:57.385180 24888 raft_consensus.cc:482] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:57.346277 25171 raft_consensus.cc:504] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:57.427269 23594 raft_consensus.cc:2454] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:57.447678 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:57.404191 25017 consensus_meta.cc:287] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent flushing consensus metadata: real 0.970s user 0.007s sys 0.006s
I20260807 13:40:57.348067 25134 raft_consensus.cc:482] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:57.407146 24853 raft_consensus.cc:482] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:57.484627 25000 raft_consensus.cc:482] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:57.455617 23599 rpcz_store.cc:276] 0807 13:40:54.142330 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:55.445249 (+1302919us) service_pool.cc:227] Handling call
0807 13:40:55.445777 (+ 528us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:55.483424 (+ 37647us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:55.483468 (+ 44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:55.493840 (+ 10372us) log.cc:842] Serialized 26 byte log entry
0807 13:40:56.343003 (+849163us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:40:56.995366 (+652363us) log.cc:842] Serialized 14 byte log entry
0807 13:40:56.995597 (+ 231us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:57.386978 (+391381us) spinlock_profiling.cc:243] Waited 29 ms on lock 0x7b54002f49d4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:40:57.387029 (+ 51us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:57.387079 (+ 50us) raft_consensus.cc:1671] finished
0807 13:40:57.387182 (+ 103us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:57.387335 (+ 153us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":74043,"prepare.queue_time_us":823435,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":162,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":22368,"spinlock_wait_cycles":66667264,"thread_start_us":1401928,"threads_started":2,"wal-append.queue_time_us":1005067}
I20260807 13:40:57.474304 23597 raft_consensus.cc:2454] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:40:57.485244 23709 raft_consensus.cc:2396] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:40:57.482622 23711 rpcz_store.cc:276] 0807 13:40:54.233783 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:54.552303 (+318520us) service_pool.cc:227] Handling call
0807 13:40:54.552753 (+ 450us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:54.924036 (+371283us) raft_consensus.cc:1520] Early marking committed up to index 2
0807 13:40:55.660879 (+736843us) log.cc:842] Serialized 14 byte log entry
0807 13:40:57.184923 (+1524044us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:57.185385 (+ 462us) log.cc:842] Serialized 26 byte log entry
0807 13:40:57.185538 (+ 153us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:40:57.185574 (+ 36us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:57.185643 (+ 69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:57.459714 (+274071us) raft_consensus.cc:1671] finished
0807 13:40:57.459737 (+ 23us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:57.459873 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":82639,"prepare.queue_time_us":88357,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":484002,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":5715,"spinlock_wait_cycles":10590976,"thread_start_us":2552317,"threads_started":4,"wal-append.queue_time_us":1058990}
I20260807 13:40:57.398988 25092 raft_consensus.cc:504] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:57.487218 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 202528us
I20260807 13:40:57.362479 25002 raft_consensus.cc:482] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:57.488502 23704 raft_consensus.cc:3037] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:57.277742 23595 rpcz_store.cc:276] 0807 13:40:54.661922 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:56.944013 (+2282091us) service_pool.cc:227] Handling call
0807 13:40:56.944449 (+ 436us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:56.976193 (+ 31744us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:56.995379 (+ 19186us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:40:57.486104 25141 log.cc:924] Time spent T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.333s user 0.000s sys 0.002s
I20260807 13:40:57.480989 23699 raft_consensus.cc:3037] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:57.407310 25088 raft_consensus.cc:504] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:57.504729 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f8a5f186bf1473a988921e5efa3e574" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:57.505355 23825 raft_consensus.cc:2454] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:57.506204 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:57.494369 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:57.444720 25023 raft_consensus.cc:504] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:57.479357 25078 raft_consensus.cc:729] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:57.460786 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:57.401633 25155 raft_consensus.cc:504] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:57.447369 25143 raft_consensus.cc:504] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:57.500043 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:57.486524 23812 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45360 (request call id 565) took 1876 ms (client timeout 2246 ms). Trace:
I20260807 13:40:57.508358 23825 raft_consensus.cc:2379] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:57.486032 25192 raft_consensus.cc:2781] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:57.464696 24795 raft_consensus.cc:504] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:57.499879 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:57.458714 25098 raft_consensus.cc:504] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:57.499411 23705 raft_consensus.cc:2379] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 4: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:57.515791 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:57.497354 24853 raft_consensus.cc:3037] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:57.495324 24999 leader_election.cc:288] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:57.590195 23709 raft_consensus.cc:2454] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 4.
I20260807 13:40:57.590394 23823 raft_consensus.cc:2454] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:57.590546 23598 raft_consensus.cc:2379] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:57.465457 25158 raft_consensus.cc:504] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:57.511198 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:57.512187 23704 raft_consensus.cc:2454] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 4.
I20260807 13:40:57.489787 24739 raft_consensus.cc:504] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:57.497310 24888 raft_consensus.cc:504] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
@ 0x7f4615aa7e87 gsignal at ??:0
I20260807 13:40:57.517227 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:58.492077 23662 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.127s user 0.020s sys 0.036s
I20260807 13:40:58.587926 23711 raft_consensus.cc:2454] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
W20260807 13:40:58.588176 23662 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.223s user 0.021s sys 0.036s
I20260807 13:40:58.588544 23711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 674) took 1231 ms. Trace:
W20260807 13:40:58.588778 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 1.31115e+06us
I20260807 13:40:58.588853 23711 rpcz_store.cc:276] 0807 13:40:57.357060 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:57.498429 (+141369us) service_pool.cc:227] Handling call
0807 13:40:58.588486 (+1090057us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:57.811803 23818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45360 (request call id 576) took 2055 ms. Trace:
I20260807 13:40:58.589526 23662 leader_election.cc:302] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:58.590073 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:57.988436 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:58.602425 23711 raft_consensus.cc:2454] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:58.603003 23711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 686) took 1114 ms. Trace:
I20260807 13:40:57.647644 25193 raft_consensus.cc:482] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
W20260807 13:40:57.819766 23535 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:40:57.662197 23814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45370 (request call id 365) took 2086 ms. Trace:
W20260807 13:40:57.643927 25170 log.cc:924] Time spent T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.215s user 0.000s sys 0.001s
I20260807 13:40:57.611491 25182 raft_consensus.cc:482] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:57.646270 24905 leader_election.cc:288] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:57.658640 24719 leader_election.cc:288] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:57.648190 25143 leader_election.cc:288] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:58.613459 23554 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.113s user 0.012s sys 0.008s
W20260807 13:40:58.613765 23554 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.113s user 0.012s sys 0.008s
I20260807 13:40:58.231952 25088 leader_election.cc:288] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:58.614722 25088 consensus_queue.cc:1035] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:57.611301 23590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 619) took 3449 ms. Trace:
W20260807 13:40:58.592914 23702 consensus_meta.cc:287] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 1.085s user 0.011s sys 0.002s
I20260807 13:40:58.615983 23702 raft_consensus.cc:2454] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:58.616554 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 676) took 1259 ms. Trace:
I20260807 13:40:58.616851 23702 rpcz_store.cc:276] 0807 13:40:57.357491 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:57.494094 (+136603us) service_pool.cc:227] Handling call
0807 13:40:58.616494 (+1122400us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:57.647405 25184 raft_consensus.cc:482] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:57.446683 23588 rpcz_store.cc:276] 0807 13:40:54.091456 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:54.476773 (+385317us) service_pool.cc:227] Handling call
0807 13:40:54.544032 (+ 67259us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:54.568874 (+ 24842us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:54.586454 (+ 17580us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:54.693392 (+106938us) log.cc:842] Serialized 26 byte log entry
0807 13:40:55.284085 (+590693us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b44000232cc. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f4619097a95 00007f46190984b2 00007f461bd40511 00007f461bd3be1a 00007f46191675fe 00007f4621f9ea39 00007f46191848bb 00007f4619182cbf 00007f4619184e22 00007f461bd2e5bb
0807 13:40:56.507983 (+1223898us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:40:57.134430 (+626447us) log.cc:842] Serialized 14 byte log entry
0807 13:40:57.200187 (+ 65757us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:57.205954 (+ 5767us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:57.243602 (+ 37648us) raft_consensus.cc:1671] finished
0807 13:40:57.335277 (+ 91675us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:57.353420 (+ 18143us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":54612,"prepare.queue_time_us":642930,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":69915,"raft.run_cpu_time_us":389,"raft.run_wall_time_us":12298,"spinlock_wait_cycles":3286784,"thread_start_us":2048921,"threads_started":2,"wal-append.queue_time_us":1605478,"wal-append.run_cpu_time_us":3667,"wal-append.run_wall_time_us":1630701}
I20260807 13:40:57.649762 25015 leader_election.cc:288] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:57.767812 25078 consensus_queue.cc:260] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:58.594523 23598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 558) took 1239 ms. Trace:
I20260807 13:40:58.624365 23598 rpcz_store.cc:276] 0807 13:40:57.355532 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:57.429113 (+ 73581us) service_pool.cc:227] Handling call
0807 13:40:58.594294 (+1165181us) spinlock_profiling.cc:243] Waited 94.3 ms on lock 0x7b5400253fd4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:40:58.594440 (+ 146us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":216789888}
I20260807 13:40:57.278889 23591 rpcz_store.cc:276] 0807 13:40:54.141538 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:55.105566 (+964028us) service_pool.cc:227] Handling call
0807 13:40:55.106301 (+ 735us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:55.106987 (+ 686us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:55.107040 (+ 53us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:55.107758 (+ 718us) log.cc:842] Serialized 26 byte log entry
0807 13:40:55.938940 (+831182us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:40:57.036364 (+1097424us) log.cc:842] Serialized 14 byte log entry
0807 13:40:57.098747 (+ 62383us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:57.133312 (+ 34565us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:57.136076 (+ 2764us) raft_consensus.cc:1671] finished
0807 13:40:57.139958 (+ 3882us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:57.149116 (+ 9158us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12756,"prepare.queue_time_us":1195925,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":69,"raft.queue_time_us":52261,"raft.run_cpu_time_us":412,"raft.run_wall_time_us":40552,"thread_start_us":1758835,"threads_started":2,"wal-append.queue_time_us":1140368}
I20260807 13:40:57.890043 24982 leader_election.cc:288] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:58.594895 25192 raft_consensus.cc:482] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:57.524783 23600 raft_consensus.cc:2454] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:40:58.640267 23600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 554) took 1285 ms. Trace:
I20260807 13:40:58.640640 23600 rpcz_store.cc:276] 0807 13:40:57.354446 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:57.362546 (+ 8100us) service_pool.cc:227] Handling call
0807 13:40:58.640204 (+1277658us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:58.240877 25190 raft_consensus.cc:482] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:57.913923 24781 leader_election.cc:288] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:58.127848 25174 log.cc:924] Time spent T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da: Append to log took a long time: real 0.367s user 0.000s sys 0.001s
I20260807 13:40:57.498551 25017 raft_consensus.cc:504] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:57.589658 25188 raft_consensus.cc:482] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:58.339279 25155 leader_election.cc:288] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:57.502424 25000 raft_consensus.cc:504] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:57.648667 25025 leader_election.cc:288] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:58.596962 23823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 404) took 1094 ms. Trace:
W20260807 13:40:57.910817 23774 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.506s user 0.004s sys 0.008s
I20260807 13:40:58.597491 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 673) took 1240 ms. Trace:
I20260807 13:40:58.597865 23710 raft_consensus.cc:2454] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:58.623924 25184 raft_consensus.cc:504] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:58.597929 23709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 684) took 1170 ms. Trace:
I20260807 13:40:57.506943 25070 leader_election.cc:288] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:57.643298 25142 log.cc:924] Time spent T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.191s user 0.000s sys 0.001s
W20260807 13:40:58.124110 25179 log.cc:924] Time spent T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.491s user 0.001s sys 0.000s
I20260807 13:40:57.498744 25134 raft_consensus.cc:504] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:57.495823 25137 leader_election.cc:288] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:57.515664 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:58.668669 23700 raft_consensus.cc:2454] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:58.669173 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 681) took 1304 ms. Trace:
I20260807 13:40:58.598913 25023 leader_election.cc:288] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:58.599207 23594 raft_consensus.cc:2354] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4.
I20260807 13:40:58.669713 25134 leader_election.cc:288] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:58.670233 23594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 557) took 1315 ms. Trace:
I20260807 13:40:58.670567 23594 rpcz_store.cc:276] 0807 13:40:57.355270 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:57.500633 (+145363us) service_pool.cc:227] Handling call
0807 13:40:58.670171 (+1169538us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:57.501608 25002 raft_consensus.cc:3037] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:57.589170 25181 raft_consensus.cc:482] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
W20260807 13:40:58.671437 23699 consensus_meta.cc:287] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 1.162s user 0.013s sys 0.000s
I20260807 13:40:58.672139 23699 raft_consensus.cc:2396] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:40:58.589597 23818 rpcz_store.cc:276] 0807 13:40:55.756529 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:55.756653 (+ 124us) service_pool.cc:227] Handling call
0807 13:40:55.756945 (+ 292us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:56.014470 (+257525us) raft_consensus.cc:1520] Early marking committed up to index 2
0807 13:40:56.359246 (+344776us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b48000c00d8. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4620f547f1 00007f4620f4b8e7 00007f4620f4b77a 00007f462103f95f 00007f462103f627 00007f4621053b2c 00007f4621053ad8 00007f4621053a58 00007f4621053a13 00007f4621052cbc 00007f461ffd4be6
0807 13:40:57.028760 (+669514us) log.cc:842] Serialized 14 byte log entry
0807 13:40:57.453179 (+424419us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:57.453246 (+ 67us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:40:57.453300 (+ 54us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:57.651564 (+198264us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b18001d8a20. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f46220248b1 00007f4622031661 00007f4619185638 00007f4619188b11 00007f4619188ac9 00007f4619188a59 00007f4619188a21 00007f4619187d1d 00007f46223e9204 00007f46223e9039 00007f4619167dc6
0807 13:40:57.811399 (+159835us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b5400349ed4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:40:57.811472 (+ 73us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:57.811692 (+ 220us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":48371,"prepare.queue_time_us":1386287,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":9630,"raft.queue_time_us":262492,"raft.run_cpu_time_us":4924,"raft.run_wall_time_us":324244,"spinlock_wait_cycles":541545856,"thread_start_us":1360278,"threads_started":3,"wal-append.queue_time_us":423143}
W20260807 13:40:57.589745 23812 rpcz_store.cc:269] 0807 13:40:55.608535 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:55.808059 (+199524us) service_pool.cc:227] Handling call
0807 13:40:57.464964 (+1656905us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b540018ecd4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:40:57.484398 (+ 19434us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1227566976}
I20260807 13:40:58.673112 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:58.673880 23699 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 664) took 1324 ms (client timeout 1564 ms). Trace:
I20260807 13:40:58.592188 24795 leader_election.cc:288] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:58.342875 23555 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.914s user 0.000s sys 0.010s
W20260807 13:40:58.683828 23555 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.255s user 0.000s sys 0.018s
I20260807 13:40:57.656351 23817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45370 (request call id 392) took 1824 ms. Trace:
I20260807 13:40:57.645257 23595 raft_consensus.cc:1261] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:40:58.601277 24952 leader_election.cc:288] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:58.601516 25158 leader_election.cc:288] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:58.072129 25173 raft_consensus.cc:482] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:57.651273 25092 leader_election.cc:288] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:40:57.644374 25165 log.cc:924] Time spent T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.249s user 0.001s sys 0.000s
I20260807 13:40:58.601644 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:58.603657 25193 raft_consensus.cc:504] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:58.656852 25195 raft_consensus.cc:482] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:58.603938 23814 rpcz_store.cc:276] 0807 13:40:55.575382 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:55.575529 (+ 147us) service_pool.cc:227] Handling call
0807 13:40:55.575949 (+ 420us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:56.653298 (+1077349us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:57.661863 (+1008565us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b5400226ad4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:40:57.662120 (+ 257us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2113824512}
I20260807 13:40:58.603998 23815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45370 (request call id 402) took 1101 ms. Trace:
I20260807 13:40:58.608081 25098 leader_election.cc:288] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:58.603299 23711 rpcz_store.cc:276] 0807 13:40:57.488889 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:58.589801 (+1100912us) service_pool.cc:227] Handling call
0807 13:40:58.602943 (+ 13142us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:58.609225 24888 leader_election.cc:288] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:58.107924 23707 consensus_meta.cc:287] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.701s user 0.010s sys 0.000s
I20260807 13:40:58.704150 23707 raft_consensus.cc:2454] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:58.704645 23707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 672) took 1348 ms. Trace:
W20260807 13:40:58.611852 24859 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.229s user 0.001s sys 0.018s
I20260807 13:40:58.704846 23707 rpcz_store.cc:276] 0807 13:40:57.356505 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:57.356629 (+ 124us) service_pool.cc:227] Handling call
0807 13:40:58.704603 (+1347974us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:40:58.625794 23768 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.132s user 0.025s sys 0.019s
I20260807 13:40:58.626686 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:58.635272 25078 raft_consensus.cc:3037] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:58.126957 25063 leader_election.cc:288] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:58.075789 25171 leader_election.cc:288] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:58.613163 25062 raft_consensus.cc:3037] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:57.656711 25038 raft_consensus.cc:482] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:58.642177 25192 raft_consensus.cc:3037] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:40:58.642103 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 53168.4us
I20260807 13:40:58.617784 24905 raft_consensus.cc:2781] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:58.662177 23823 rpcz_store.cc:276] 0807 13:40:57.503004 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:57.503131 (+ 127us) service_pool.cc:227] Handling call
0807 13:40:58.596898 (+1093767us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:58.671577 25181 raft_consensus.cc:504] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:57.957932 24956 leader_election.cc:288] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:40:58.064900 25004 consensus_meta.cc:287] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812: Time spent flushing consensus metadata: real 0.876s user 0.006s sys 0.006s
I20260807 13:40:58.663388 23709 rpcz_store.cc:276] 0807 13:40:57.427634 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:57.499624 (+ 71990us) service_pool.cc:227] Handling call
0807 13:40:58.597860 (+1098236us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:58.663276 23710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 685) took 1205 ms. Trace:
I20260807 13:40:58.697245 24795 raft_consensus.cc:482] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:58.665001 23820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45370 (request call id 394) took 2731 ms. Trace:
W20260807 13:40:58.712095 24859 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.341s user 0.002s sys 0.019s
I20260807 13:40:58.658438 25155 consensus_queue.cc:1035] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
W20260807 13:40:58.683662 23699 rpcz_store.cc:269] 0807 13:40:57.349387 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:57.351735 (+ 2348us) service_pool.cc:227] Handling call
0807 13:40:58.673465 (+1321730us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:58.659294 25033 leader_election.cc:288] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:58.669490 23700 rpcz_store.cc:276] 0807 13:40:57.365056 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:57.493620 (+128564us) service_pool.cc:227] Handling call
0807 13:40:58.669119 (+1175499us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:40:58.713510 23768 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.221s user 0.026s sys 0.019s
I20260807 13:40:58.662458 23704 rpcz_store.cc:276] 0807 13:40:57.356785 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:57.428046 (+ 71261us) service_pool.cc:227] Handling call
0807 13:40:58.597429 (+1169383us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:58.665202 25188 raft_consensus.cc:504] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:58.673115 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:58.677577 24853 raft_consensus.cc:504] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:58.697168 25017 leader_election.cc:288] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:58.667948 25197 raft_consensus.cc:482] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:58.703405 25158 raft_consensus.cc:482] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:58.723666 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:58.724436 25004 raft_consensus.cc:504] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:58.739888 24982 raft_consensus.cc:482] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:58.740562 24982 raft_consensus.cc:504] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:58.741214 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "830e8cb8ce434e6391c09530c677a61d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:58.742022 23823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 411) took 1084 ms. Trace:
I20260807 13:40:58.742327 23823 rpcz_store.cc:276] 0807 13:40:57.657675 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:58.740939 (+1083264us) service_pool.cc:227] Handling call
0807 13:40:58.741964 (+ 1025us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:58.743196 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:58.743922 23823 raft_consensus.cc:2379] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 3: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:58.662801 25198 consensus_queue.cc:1035] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
I20260807 13:40:58.724128 23821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45370 (request call id 393) took 2815 ms. Trace:
@ 0x7f4615aa97f1 abort at ??:0
I20260807 13:40:58.745713 24982 leader_election.cc:288] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
@ 0x2a0007 __interceptor_abort at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:263
I20260807 13:40:58.746021 23821 rpcz_store.cc:276] 0807 13:40:55.908585 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:55.911080 (+ 2495us) service_pool.cc:227] Handling call
0807 13:40:55.926593 (+ 15513us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:40:55.946627 (+ 20034us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:55.946683 (+ 56us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:40:55.958492 (+ 11809us) log.cc:842] Serialized 52 byte log entry
0807 13:40:57.187786 (+1229294us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:57.187812 (+ 26us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:57.187860 (+ 48us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:58.723852 (+1535992us) raft_consensus.cc:1671] finished
0807 13:40:58.723883 (+ 31us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:58.724049 (+ 166us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10640,"raft.queue_time_us":10791,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":16669,"thread_start_us":1079676,"threads_started":1,"wal-append.queue_time_us":1202474}
I20260807 13:40:58.747900 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:58.751106 23812 raft_consensus.cc:2396] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:40:58.725102 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9552d42b445450691daef21fba4059a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:58.738139 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:58.725231 23710 rpcz_store.cc:276] 0807 13:40:57.458196 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:57.483060 (+ 24864us) service_pool.cc:227] Handling call
0807 13:40:58.663111 (+1180051us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540035bbd4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:40:58.663220 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2561700736}
I20260807 13:40:58.753464 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:58.684861 23554 leader_election.cc:302] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:58.644891 24739 leader_election.cc:288] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:58.653069 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:40:58.693737 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 103346us
I20260807 13:40:58.732192 25197 raft_consensus.cc:504] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:57.941143 25007 leader_election.cc:288] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:58.611263 25182 raft_consensus.cc:504] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:58.712074 23825 raft_consensus.cc:2454] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:58.715431 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:58.731545 25205 raft_consensus.cc:482] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:58.759208 23825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45360 (request call id 585) took 1096 ms. Trace:
I20260807 13:40:58.759356 23707 raft_consensus.cc:2454] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:58.759714 23825 rpcz_store.cc:276] 0807 13:40:57.662520 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:57.770034 (+107514us) service_pool.cc:227] Handling call
0807 13:40:58.759156 (+989122us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:58.760206 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:58.759788 25205 raft_consensus.cc:504] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:58.760644 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:58.760793 23707 raft_consensus.cc:2454] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:58.761171 23825 raft_consensus.cc:3037] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:58.761677 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:58.713752 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 680) took 1351 ms. Trace:
I20260807 13:40:58.762787 23702 rpcz_store.cc:276] 0807 13:40:57.362169 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:58.625466 (+1263297us) service_pool.cc:227] Handling call
0807 13:40:58.713688 (+ 88222us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:58.686858 23817 rpcz_store.cc:276] 0807 13:40:55.832119 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:55.926991 (+ 94872us) service_pool.cc:227] Handling call
0807 13:40:55.965219 (+ 38228us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:40:56.091727 (+126508us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:56.099692 (+ 7965us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:40:56.232495 (+132803us) log.cc:842] Serialized 52 byte log entry
0807 13:40:56.754237 (+521742us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:40:56.754305 (+ 68us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:56.754407 (+ 102us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:57.656078 (+901671us) raft_consensus.cc:1671] finished
0807 13:40:57.656106 (+ 28us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:57.656268 (+ 162us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9754,"raft.queue_time_us":48662,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":33175,"thread_start_us":483264,"threads_started":1,"wal-append.queue_time_us":757569,"wal-append.run_cpu_time_us":4416,"wal-append.run_wall_time_us":1628117}
I20260807 13:40:58.763603 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:58.763741 23821 raft_consensus.cc:2454] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:58.764174 23702 raft_consensus.cc:2454] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:58.764720 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:58.765079 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:58.675529 24941 consensus_meta.cc:287] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 1.191s user 0.011s sys 0.001s
I20260807 13:40:58.765457 23821 raft_consensus.cc:2454] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:58.710227 23595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 562) took 1347 ms. Trace:
I20260807 13:40:58.651647 25190 raft_consensus.cc:504] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:58.682356 25002 raft_consensus.cc:504] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:58.762409 25205 leader_election.cc:288] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:58.728816 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:58.754644 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 70322.6us
I20260807 13:40:58.725585 23820 rpcz_store.cc:276] 0807 13:40:55.933475 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:55.933623 (+ 148us) service_pool.cc:227] Handling call
0807 13:40:55.949140 (+ 15517us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:40:55.949585 (+ 445us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:55.949623 (+ 38us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:40:55.969106 (+ 19483us) log.cc:842] Serialized 52 byte log entry
0807 13:40:57.234312 (+1265206us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:57.234381 (+ 69us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:57.234487 (+ 106us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:58.664764 (+1430277us) raft_consensus.cc:1671] finished
0807 13:40:58.664789 (+ 25us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:58.664921 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":39810,"raft.queue_time_us":113,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":17979,"thread_start_us":888732,"threads_started":1,"wal-append.queue_time_us":1079353}
I20260807 13:40:58.772193 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:58.664614 25184 leader_election.cc:288] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:58.728174 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:58.725186 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:58.752847 23709 raft_consensus.cc:2454] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:58.727214 25193 leader_election.cc:288] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:58.730300 25200 raft_consensus.cc:482] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:58.764030 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:58.785537 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac6e18ecd14ba2a7d3e846a9fc81bf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:58.661897 25000 leader_election.cc:288] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:58.734046 23818 raft_consensus.cc:2454] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:58.787032 23818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45360 (request call id 586) took 1019 ms. Trace:
I20260807 13:40:58.770895 23595 rpcz_store.cc:276] 0807 13:40:57.356538 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:57.593212 (+236674us) service_pool.cc:227] Handling call
0807 13:40:57.644832 (+ 51620us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:58.689956 (+1045124us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:58.703571 (+ 13615us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:58.787456 23818 rpcz_store.cc:276] 0807 13:40:57.767305 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:58.672785 (+905480us) service_pool.cc:227] Handling call
0807 13:40:58.786978 (+114193us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":43904}
I20260807 13:40:58.788013 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:58.783697 23814 raft_consensus.cc:3037] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:58.788327 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:58.788655 25002 leader_election.cc:288] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:58.789665 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c1184114b02410098331e68d3b8d4cf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:58.755992 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:58.790307 23710 raft_consensus.cc:2454] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:58.790997 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4062e0223a4cc0b2e448e35445671d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:58.791191 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:58.792059 23710 raft_consensus.cc:2396] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:40:58.792133 23709 raft_consensus.cc:2396] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 13:40:58.792776 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:58.767796 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:58.793325 23710 raft_consensus.cc:2454] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:58.793154 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:58.757325 23662 leader_election.cc:302] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:58.769443 23597 raft_consensus.cc:1261] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:40:58.794175 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:58.794363 23709 raft_consensus.cc:2379] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 4: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:58.695297 25173 raft_consensus.cc:504] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:58.794951 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:58.795636 23597 raft_consensus.cc:2379] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 3: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:58.762421 23707 raft_consensus.cc:2396] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:40:58.754195 23823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45360 (request call id 581) took 1092 ms. Trace:
I20260807 13:40:58.774188 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:58.775146 23702 raft_consensus.cc:2396] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:40:58.774289 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c1184114b02410098331e68d3b8d4cf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:58.731256 25092 raft_consensus.cc:482] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:58.727581 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:58.731854 25038 raft_consensus.cc:504] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:58.769515 23599 raft_consensus.cc:3032] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:40:58.733520 24905 raft_consensus.cc:686] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:58.755686 25017 raft_consensus.cc:2781] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:58.735594 25158 raft_consensus.cc:504] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:58.725459 24795 raft_consensus.cc:504] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:58.758977 25182 leader_election.cc:288] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:58.775205 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:58.730547 25188 leader_election.cc:288] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:58.756122 24853 leader_election.cc:288] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:58.772113 24941 raft_consensus.cc:2726] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:58.779402 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:58.771797 25197 leader_election.cc:288] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:58.726941 25181 leader_election.cc:288] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:58.615746 23590 rpcz_store.cc:276] 0807 13:40:54.143009 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:55.503164 (+1360155us) service_pool.cc:227] Handling call
0807 13:40:55.503756 (+ 592us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:55.538127 (+ 34371us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:55.539603 (+ 1476us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:55.549758 (+ 10155us) log.cc:842] Serialized 26 byte log entry
0807 13:40:55.940065 (+390307us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:40:57.365171 (+1425106us) log.cc:842] Serialized 14 byte log entry
0807 13:40:57.492863 (+127692us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:57.496672 (+ 3809us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:57.500723 (+ 4051us) raft_consensus.cc:1671] finished
0807 13:40:57.503684 (+ 2961us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:57.592117 (+ 88433us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":72115,"prepare.queue_time_us":1209061,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":41,"raft.queue_time_us":277451,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":2155,"thread_start_us":1817303,"threads_started":3,"wal-append.queue_time_us":894558,"wal-append.run_cpu_time_us":3486,"wal-append.run_wall_time_us":2030959}
I20260807 13:40:58.755000 23812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 414) took 1093 ms. Trace:
I20260807 13:40:58.778880 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9552d42b445450691daef21fba4059a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:58.702831 25195 raft_consensus.cc:504] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:58.700704 23815 rpcz_store.cc:276] 0807 13:40:57.502364 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:57.504018 (+ 1654us) service_pool.cc:227] Handling call
0807 13:40:58.127037 (+623019us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b5800255098. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f46210032b0 00007f4620fee7f9 00007f4620fee2a2 00007f461a6d4684
0807 13:40:58.602899 (+475862us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x7b5800255098. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914db7c 00007f461914d73b 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f46210032b0 00007f4620fee7f9 00007f4620fee2a2 00007f461a6d4684
0807 13:40:58.603150 (+ 251us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:58.603412 (+ 262us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:58.603460 (+ 48us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:58.603627 (+ 167us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:40:58.603689 (+ 62us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:58.603768 (+ 79us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:58.603928 (+ 160us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":54621952}
I20260807 13:40:58.789779 23601 raft_consensus.cc:2379] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 4: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:58.793764 23600 raft_consensus.cc:2379] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 4: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:58.770957 24739 raft_consensus.cc:482] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:58.756916 23813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 408) took 1125 ms. Trace:
I20260807 13:40:58.796197 25173 leader_election.cc:288] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:58.827776 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:58.796377 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:58.797609 23707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 678) took 1439 ms. Trace:
I20260807 13:40:58.799280 23702 raft_consensus.cc:1226] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 3. Current term is 4. Ops: []
I20260807 13:40:58.797734 23823 rpcz_store.cc:276] 0807 13:40:57.661469 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:58.744498 (+1083029us) service_pool.cc:227] Handling call
0807 13:40:58.754142 (+ 9644us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:58.831439 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 679) took 1473 ms. Trace:
I20260807 13:40:58.798205 23598 raft_consensus.cc:2379] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 4: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:58.800509 23599 raft_consensus.cc:729] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:58.832017 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:58.830410 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:58.833020 23818 raft_consensus.cc:2454] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:58.801136 24905 consensus_queue.cc:237] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:58.833614 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:58.833884 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:58.799613 23711 raft_consensus.cc:2454] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:58.835136 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:58.835835 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:58.836216 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:58.836788 23818 raft_consensus.cc:3037] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:58.827529 23554 leader_election.cc:302] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
W20260807 13:40:58.809684 23769 connection.cc:232] RPC call timeout handler was delayed by -1.088618456851691s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
W20260807 13:40:58.818033 23601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 559) took 1462 ms (client timeout 1800 ms). Trace:
I20260807 13:40:58.780815 23825 raft_consensus.cc:2454] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:40:58.825219 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 662) took 1479 ms. Trace:
I20260807 13:40:58.836488 23711 raft_consensus.cc:2362] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3. Re-sending same reply.
I20260807 13:40:58.834393 23823 raft_consensus.cc:2454] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:40:58.837968 23710 raft_consensus.cc:2379] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:58.796109 23709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 677) took 1438 ms. Trace:
I20260807 13:40:58.805296 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:58.829299 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:58.856554 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:58.830209 23707 rpcz_store.cc:276] 0807 13:40:57.357805 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:58.796814 (+1439009us) service_pool.cc:227] Handling call
0807 13:40:58.797095 (+ 281us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:58.797410 (+ 315us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:58.797555 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:58.855363 23703 rpcz_store.cc:276] 0807 13:40:57.346327 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:57.346511 (+ 184us) service_pool.cc:227] Handling call
0807 13:40:57.347047 (+ 536us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:58.628247 (+1281200us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:58.628279 (+ 32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:58.628765 (+ 486us) log.cc:842] Serialized 26 byte log entry
0807 13:40:58.752326 (+123561us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:58.752377 (+ 51us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:58.770803 (+ 18426us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540007fb54. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:40:58.770904 (+ 101us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:40:58.824899 (+ 53995us) raft_consensus.cc:1671] finished
0807 13:40:58.824919 (+ 20us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:58.825157 (+ 238us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":41405,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":11086,"spinlock_wait_cycles":2880331136,"thread_start_us":151466,"threads_started":2,"wal-append.queue_time_us":194430}
I20260807 13:40:58.981191 23710 raft_consensus.cc:2454] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:58.981487 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:58.981880 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:58.982103 23597 raft_consensus.cc:3037] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:58.981949 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:58.854981 23601 rpcz_store.cc:269] 0807 13:40:57.355769 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:57.447583 (+ 91814us) service_pool.cc:227] Handling call
0807 13:40:58.817785 (+1370202us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54000555d4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:40:58.817961 (+ 176us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2943901056}
I20260807 13:40:58.831799 23702 rpcz_store.cc:276] 0807 13:40:57.357954 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:58.798818 (+1440864us) service_pool.cc:227] Handling call
0807 13:40:58.799105 (+ 287us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:58.831191 (+ 32086us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:58.831384 (+ 193us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:58.982110 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "830e8cb8ce434e6391c09530c677a61d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:58.936894 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 189039us
I20260807 13:40:58.974833 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:58.983626 23710 raft_consensus.cc:2454] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:58.984052 23598 raft_consensus.cc:3037] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:58.984459 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:58.985031 23710 raft_consensus.cc:2454] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:58.985798 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:58.986223 23660 leader_election.cc:302] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:58.982921 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:58.986304 23710 raft_consensus.cc:3037] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:58.982681 23707 raft_consensus.cc:2379] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:58.988185 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:58.982635 23703 raft_consensus.cc:2454] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:58.855340 23825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 409) took 1198 ms. Trace:
I20260807 13:40:58.989494 23825 rpcz_store.cc:276] 0807 13:40:57.656991 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:58.760418 (+1103427us) service_pool.cc:227] Handling call
0807 13:40:58.855283 (+ 94865us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:40:58.922472 23772 leader_election.cc:334] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Timed out: RequestConsensusVote RPC to 127.21.82.65:33187 timed out after 1.822s (SENT)
I20260807 13:40:58.952754 23818 raft_consensus.cc:2454] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:40:58.857342 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:58.990919 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 68478.7us
I20260807 13:40:58.991185 23704 raft_consensus.cc:2454] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:40:58.991822 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:58.802402 23588 raft_consensus.cc:1261] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:40:58.816020 23820 raft_consensus.cc:2454] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
W20260807 13:40:58.815169 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 57916.1us
I20260807 13:40:59.097208 23662 leader_election.cc:302] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:58.805537 23821 raft_consensus.cc:2362] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3. Re-sending same reply.
I20260807 13:40:58.988843 23707 raft_consensus.cc:2454] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:59.098577 23662 leader_election.cc:398] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Vote denied by peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187) with higher term. Message: Invalid argument: T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
I20260807 13:40:59.099118 25078 raft_consensus.cc:2726] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:40:59.099327 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:58.992641 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f8a5f186bf1473a988921e5efa3e574" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:59.100512 23818 raft_consensus.cc:2454] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:40:59.100934 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:58.856415 23709 rpcz_store.cc:276] 0807 13:40:57.357656 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:58.795140 (+1437484us) service_pool.cc:227] Handling call
0807 13:40:58.795518 (+ 378us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:58.795722 (+ 204us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:58.795769 (+ 47us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:58.795822 (+ 53us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:58.795864 (+ 42us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:58.795928 (+ 64us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:58.796051 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:58.800388 23699 raft_consensus.cc:2396] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:40:59.102414 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.103188 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.103425 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.103901 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.104296 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.104508 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.105006 23709 raft_consensus.cc:2454] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:58.987161 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f8a5f186bf1473a988921e5efa3e574" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.106269 23702 raft_consensus.cc:2454] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:40:59.106846 23818 raft_consensus.cc:1261] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:40:58.809903 23595 raft_consensus.cc:3037] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:59.108621 23702 raft_consensus.cc:1226] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:59.108772 23818 raft_consensus.cc:1261] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:59.109769 23702 raft_consensus.cc:1226] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 2. Current term is 3. Ops: []
I20260807 13:40:59.112023 23821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45360 (request call id 584) took 1449 ms. Trace:
I20260807 13:40:59.112386 23821 rpcz_store.cc:276] 0807 13:40:57.662265 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:59.098591 (+1436326us) service_pool.cc:227] Handling call
0807 13:40:59.111549 (+ 12958us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:59.111731 (+ 182us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:59.111756 (+ 25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:59.111793 (+ 37us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:40:59.111824 (+ 31us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:59.111883 (+ 59us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:59.111971 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:58.801294 25017 raft_consensus.cc:482] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:58.959579 25062 raft_consensus.cc:2781] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:58.815706 24795 leader_election.cc:288] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:59.006137 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 687) took 1505 ms. Trace:
I20260807 13:40:58.992501 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 688) took 1379 ms. Trace:
I20260807 13:40:58.806850 23705 raft_consensus.cc:3037] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:58.816887 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:59.017438 23823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45370 (request call id 410) took 1360 ms. Trace:
I20260807 13:40:59.125442 23823 rpcz_store.cc:276] 0807 13:40:57.657383 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:59.011071 (+1353688us) service_pool.cc:227] Handling call
0807 13:40:59.016976 (+ 5905us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:59.017150 (+ 174us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:59.017172 (+ 22us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:59.017210 (+ 38us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:40:59.017237 (+ 27us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:59.017286 (+ 49us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:59.017384 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:58.805414 25190 leader_election.cc:288] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:59.021533 23710 raft_consensus.cc:2454] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:40:58.817729 25195 leader_election.cc:288] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:58.815364 25000 raft_consensus.cc:2726] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:40:58.802948 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:59.135774 23591 raft_consensus.cc:2396] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:40:59.136839 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9552d42b445450691daef21fba4059a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.137720 23591 raft_consensus.cc:2379] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:58.812860 23814 raft_consensus.cc:2454] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:40:59.139024 23814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 413) took 1480 ms. Trace:
I20260807 13:40:59.140170 23814 rpcz_store.cc:276] 0807 13:40:57.658288 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:58.710192 (+1051904us) service_pool.cc:227] Handling call
0807 13:40:59.138965 (+428773us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:59.142812 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.016743 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:58.799860 25092 raft_consensus.cc:504] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:59.143594 23588 raft_consensus.cc:2454] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:59.143812 23601 raft_consensus.cc:2379] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 3: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:59.144594 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f8a5f186bf1473a988921e5efa3e574" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.144718 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.145016 25092 leader_election.cc:288] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:59.025940 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 682) took 1640 ms. Trace:
I20260807 13:40:58.803845 25004 leader_election.cc:288] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:59.145352 23601 raft_consensus.cc:2454] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:58.827222 24853 consensus_queue.cc:1046] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.191s
I20260807 13:40:59.146226 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:58.811894 23812 rpcz_store.cc:276] 0807 13:40:57.658598 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:58.672823 (+1014225us) service_pool.cc:227] Handling call
0807 13:40:58.752015 (+ 79192us) spinlock_profiling.cc:243] Waited 56.6 ms on lock 0x7b54002d6254. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:40:58.752167 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":130187008}
I20260807 13:40:59.029708 23598 raft_consensus.cc:2454] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:59.030251 23817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45370 (request call id 412) took 1372 ms. Trace:
I20260807 13:40:59.030797 25007 raft_consensus.cc:2781] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:59.031452 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:58.801455 25038 leader_election.cc:288] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:58.802933 25158 leader_election.cc:288] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:59.047143 23597 raft_consensus.cc:2454] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 4.
I20260807 13:40:58.811964 25172 raft_consensus.cc:482] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:59.051662 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:59.054931 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 199861us
I20260807 13:40:58.986133 25192 raft_consensus.cc:504] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:58.822960 24739 raft_consensus.cc:504] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:58.823175 23813 rpcz_store.cc:276] 0807 13:40:57.631338 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:58.015449 (+384111us) service_pool.cc:227] Handling call
0807 13:40:58.641018 (+625569us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b5800255098. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f4620fef1b0 00007f4620feea94 00007f461a6d6c04 00007f461a6d6b92
0807 13:40:58.756859 (+115841us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8524160}
I20260807 13:40:59.061775 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.062532 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:59.071854 23541 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da: Sending DeleteTablet for 3 replicas of tablet 1f8a5f186bf1473a988921e5efa3e574
I20260807 13:40:59.079492 23555 leader_election.cc:302] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:59.085904 23448 catalog_manager.cc:5495] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:59.088198 23449 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37968 (request call id 128) took 6037 ms. Trace:
I20260807 13:40:59.099778 25078 consensus_queue.cc:1035] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:59.115032 23709 raft_consensus.cc:1261] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:59.115537 23702 raft_consensus.cc:1261] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:40:58.803061 25200 raft_consensus.cc:504] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:59.116559 23662 leader_election.cc:302] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:59.118067 23820 raft_consensus.cc:1226] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260807 13:40:59.120383 23704 rpcz_store.cc:276] 0807 13:40:57.613294 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:58.991797 (+1378503us) service_pool.cc:227] Handling call
0807 13:40:58.992066 (+ 269us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:58.992222 (+ 156us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:58.992246 (+ 24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:58.992286 (+ 40us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:40:58.992314 (+ 28us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:58.992360 (+ 46us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:58.992453 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:59.116153 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.158622 23820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45360 (request call id 583) took 1496 ms. Trace:
I20260807 13:40:59.159052 23600 raft_consensus.cc:3037] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:59.159273 23820 rpcz_store.cc:276] 0807 13:40:57.662021 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:59.096678 (+1434657us) service_pool.cc:227] Handling call
0807 13:40:59.117727 (+ 21049us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:59.158397 (+ 40670us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:59.158573 (+ 176us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:59.160989 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.161793 23598 raft_consensus.cc:2454] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:59.162985 23594 raft_consensus.cc:2379] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 4: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
W20260807 13:40:59.167328 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 88031.6us
I20260807 13:40:59.168287 23555 leader_election.cc:302] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:59.169718 23555 leader_election.cc:302] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:59.171334 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:59.172068 23597 raft_consensus.cc:2362] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 4. Re-sending same reply.
I20260807 13:40:59.174405 23448 catalog_manager.cc:5495] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 2 to 4, leader changed from 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66) to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 4 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:59.146420 24853 consensus_queue.cc:1225] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer d28e736aee9f4f01b013de670a762697 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260807 13:40:59.132332 23710 raft_consensus.cc:1261] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:59.121780 25062 raft_consensus.cc:482] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:59.138499 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.120281 23703 rpcz_store.cc:276] 0807 13:40:57.500429 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:59.004944 (+1504515us) service_pool.cc:227] Handling call
0807 13:40:59.005435 (+ 491us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:59.005675 (+ 240us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:59.005712 (+ 37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:59.005781 (+ 69us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:59.005823 (+ 42us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:59.005894 (+ 71us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:59.006051 (+ 157us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:40:59.182288 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 65840.5us
I20260807 13:40:59.123024 23825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45360 (request call id 582) took 1461 ms. Trace:
I20260807 13:40:59.182998 23825 rpcz_store.cc:276] 0807 13:40:57.661773 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:59.096126 (+1434353us) service_pool.cc:227] Handling call
0807 13:40:59.122321 (+ 26195us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:59.122546 (+ 225us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:59.122582 (+ 36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:59.122636 (+ 54us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:40:59.122726 (+ 90us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:59.122804 (+ 78us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:59.122951 (+ 147us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:59.176678 23448 catalog_manager.cc:5495] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 1 to 2, leader changed from d28e736aee9f4f01b013de670a762697 (127.21.82.67) to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 2 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:59.119936 25017 raft_consensus.cc:3037] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:59.158006 23601 raft_consensus.cc:2454] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:59.187696 23448 catalog_manager.cc:5495] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 1 to 2, leader changed from 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66) to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 2 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:40:59.196122 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.197511 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.198350 23598 raft_consensus.cc:2454] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:59.199430 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.181481 23590 raft_consensus.cc:3037] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:59.202209 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.203644 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:59.205655 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:59.181555 25172 raft_consensus.cc:504] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:59.214007 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.157878 23449 rpcz_store.cc:276] 0807 13:40:53.051162 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:53.051401 (+ 239us) service_pool.cc:227] Handling call
0807 13:40:59.088100 (+6036699us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:40:56.429875 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:40:56.584945 (+155070us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:40:56.587742 (+ 2797us) write_op.cc:435] Acquired schema lock
0807 13:40:56.589772 (+ 2030us) tablet.cc:660] Decoding operations
0807 13:40:56.727650 (+137878us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:40:56.746038 (+ 18388us) write_op.cc:641] Partition lock acquired for write op
0807 13:40:56.749408 (+ 3370us) tablet.cc:683] Acquiring locks for 1 operations
0807 13:40:56.892422 (+143014us) tablet.cc:699] Row locks acquired
0807 13:40:56.949239 (+ 56817us) write_op.cc:260] PREPARE: finished
0807 13:40:56.949437 (+ 198us) write_op.cc:270] Start()
0807 13:40:56.949580 (+ 143us) write_op.cc:276] Timestamp: P: 1786110056949385 usec, L: 0
0807 13:40:56.949607 (+ 27us) op_driver.cc:331] REPLICATION: starting
0807 13:40:56.950409 (+ 802us) log.cc:842] Serialized 537 byte log entry
0807 13:40:58.973955 (+2023546us) op_driver.cc:444] REPLICATION: finished
0807 13:40:59.059778 (+ 85823us) write_op.cc:301] APPLY: starting
0807 13:40:59.059854 (+ 76us) tablet.cc:1365] starting BulkCheckPresence
0807 13:40:59.059965 (+ 111us) tablet.cc:1368] finished BulkCheckPresence
0807 13:40:59.064368 (+ 4403us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:40:59.064585 (+ 217us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:40:59.064740 (+ 155us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 13:40:59.064796 (+ 56us) write_op.cc:312] APPLY: finished
0807 13:40:59.064979 (+ 183us) log.cc:842] Serialized 22 byte log entry
0807 13:40:59.065147 (+ 168us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:40:59.065232 (+ 85us) write_op.cc:454] Released schema lock
0807 13:40:59.065281 (+ 49us) write_op.cc:341] FINISH: Updating metrics
0807 13:40:59.065547 (+ 266us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:40:59.065574 (+ 27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":786254,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":85534,"apply.run_cpu_time_us":1828,"apply.run_wall_time_us":6022,"num_ops":1,"prepare.queue_time_us":909557,"prepare.run_cpu_time_us":142645,"prepare.run_wall_time_us":960429,"raft.queue_time_us":628616,"raft.run_cpu_time_us":23119,"raft.run_wall_time_us":107501,"replication_time_us":2024235,"thread_start_us":961839,"threads_started":4,"wal-append.queue_time_us":639339}]]}
W20260807 13:40:59.221987 23662 connection.cc:232] RPC call timeout handler was delayed by -1.666254929965362s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
W20260807 13:40:59.222491 23662 connection.cc:232] RPC call timeout handler was delayed by -1.5906549298670143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
W20260807 13:40:59.222862 23662 connection.cc:232] RPC call timeout handler was delayed by -1.515954929869622s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1769s for a response
W20260807 13:40:59.223388 23662 connection.cc:232] RPC call timeout handler was delayed by -1.488054929766804s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18000000000000002s for a response
W20260807 13:40:59.223718 23662 connection.cc:232] RPC call timeout handler was delayed by -1.3575549297966063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1945s for a response
I20260807 13:40:59.223567 23555 leader_election.cc:302] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
W20260807 13:40:59.224140 23662 connection.cc:232] RPC call timeout handler was delayed by -1.1910549299791455s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.213s for a response
W20260807 13:40:59.224524 23662 connection.cc:232] RPC call timeout handler was delayed by -1.0893549299798906s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2243s for a response
W20260807 13:40:59.224871 23662 connection.cc:232] RPC call timeout handler was delayed by -1.0866549299098551s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22460000000000002s for a response
I20260807 13:40:59.227785 25025 raft_consensus.cc:2726] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:40:59.229022 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.229173 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:59.230037 23821 raft_consensus.cc:2379] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:59.230307 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9552d42b445450691daef21fba4059a" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:59.231490 23825 raft_consensus.cc:2396] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 13:40:59.182881 25004 raft_consensus.cc:2726] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:59.182369 25062 raft_consensus.cc:3037] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:59.179247 25190 raft_consensus.cc:2726] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:40:59.145571 23700 rpcz_store.cc:276] 0807 13:40:57.385327 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:58.804487 (+1419160us) service_pool.cc:227] Handling call
0807 13:40:58.861426 (+ 56939us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:58.971986 (+110560us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:58.972958 (+ 972us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:58.974767 (+ 1809us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:40:58.985631 (+ 10864us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:58.998593 (+ 12962us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:59.025737 (+ 27144us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b5400071550. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0aca09 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:40:59.025869 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":72721664}
I20260807 13:40:59.237277 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:59.158826 25007 raft_consensus.cc:482] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:59.178793 25092 raft_consensus.cc:482] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:40:59.148780 23595 raft_consensus.cc:2454] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 4.
I20260807 13:40:59.208251 25209 raft_consensus.cc:2726] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:40:59.208886 25197 raft_consensus.cc:482] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:40:59.208943 25038 raft_consensus.cc:2726] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:40:59.233987 23599 consensus_queue.cc:260] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:59.252584 23599 raft_consensus.cc:3037] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:59.238013 23825 raft_consensus.cc:3037] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:40:59.254122 23660 leader_election.cc:334] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Timed out: RequestConsensusVote RPC to 127.21.82.67:46685 timed out after 2.068s (SENT)
I20260807 13:40:59.238876 23555 leader_election.cc:302] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:59.255825 23594 raft_consensus.cc:2454] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:59.255996 23555 leader_election.cc:302] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:59.244029 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.256842 23597 raft_consensus.cc:2454] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:40:59.245220 23601 raft_consensus.cc:2454] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:59.252594 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:59.174852 23817 rpcz_store.cc:276] 0807 13:40:57.657974 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:59.029312 (+1371338us) service_pool.cc:227] Handling call
0807 13:40:59.029695 (+ 383us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:40:59.029892 (+ 197us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:59.029919 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:40:59.029968 (+ 49us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:40:59.030001 (+ 33us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:40:59.030063 (+ 62us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:40:59.030186 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:40:59.258190 23823 raft_consensus.cc:2396] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:40:59.273515 23555 leader_election.cc:302] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:59.253070 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.276368 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:59.246397 23600 raft_consensus.cc:2454] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:59.216542 23591 raft_consensus.cc:2454] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:59.236123 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:59.291239 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:59.292133 23821 raft_consensus.cc:2379] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 4: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:59.234617 25143 consensus_queue.cc:1035] T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.023s
I20260807 13:40:59.247869 25007 raft_consensus.cc:3037] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:59.277314 23818 raft_consensus.cc:2454] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:59.247390 25092 raft_consensus.cc:504] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:59.280520 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.306172 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.287478 23555 leader_election.cc:302] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:59.316633 23597 raft_consensus.cc:2454] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:59.319662 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:59.320034 23555 leader_election.cc:302] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:59.321136 23825 raft_consensus.cc:2454] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:59.276561 25038 raft_consensus.cc:2726] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:59.325363 23555 leader_election.cc:302] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:59.328004 23555 leader_election.cc:302] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:59.329502 23555 leader_election.cc:302] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:59.283207 25190 raft_consensus.cc:2781] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:59.351346 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:59.354367 23825 raft_consensus.cc:2454] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:59.306079 25195 raft_consensus.cc:2726] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:40:59.355543 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:59.356060 23818 raft_consensus.cc:3037] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:59.331593 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:59.358031 23599 pending_rounds.cc:76] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812: Aborting all ops after (but not including) 0
I20260807 13:40:59.358341 23599 pending_rounds.cc:97] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812: Aborting uncommitted NO_OP operation due to leader change: 2.1
I20260807 13:40:59.358880 23599 raft_consensus.cc:2866] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:40:59.358752 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:59.360807 23555 leader_election.cc:302] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:59.362185 23555 leader_election.cc:302] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:59.364228 23555 leader_election.cc:302] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:59.362867 24888 raft_consensus.cc:2781] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:59.360852 23599 raft_consensus.cc:1226] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 3. Current term is 4. Ops: []
I20260807 13:40:59.351016 25063 raft_consensus.cc:2726] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:40:59.367743 24888 raft_consensus.cc:482] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:59.352474 24853 raft_consensus.cc:2726] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:40:59.368655 23555 leader_election.cc:302] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:59.357928 23817 raft_consensus.cc:2454] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:59.368178 24888 raft_consensus.cc:3037] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:59.367063 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:59.375629 25063 raft_consensus.cc:2781] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:59.376039 25063 raft_consensus.cc:482] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:59.376434 25063 raft_consensus.cc:3037] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:59.368813 24853 raft_consensus.cc:2781] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:40:59.377610 24853 raft_consensus.cc:482] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:59.378033 24853 raft_consensus.cc:3037] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:59.369397 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:59.379416 23823 raft_consensus.cc:3037] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:59.380201 23555 leader_election.cc:302] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:59.370460 25172 leader_election.cc:288] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:59.365571 25062 raft_consensus.cc:504] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:59.381103 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.381399 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.405300 23597 raft_consensus.cc:2454] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:59.358273 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.406509 23591 raft_consensus.cc:2454] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:59.406579 25038 raft_consensus.cc:2726] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:59.409114 23598 raft_consensus.cc:2379] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 3: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:59.332441 25025 raft_consensus.cc:2726] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:59.257750 25197 raft_consensus.cc:504] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:59.352663 25190 raft_consensus.cc:482] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:59.412302 23600 raft_consensus.cc:2454] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 4.
I20260807 13:40:59.350780 25004 raft_consensus.cc:2726] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:40:59.415215 23823 raft_consensus.cc:2454] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:40:59.410641 23555 leader_election.cc:302] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:59.351603 25070 raft_consensus.cc:3037] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:59.408937 23595 raft_consensus.cc:2396] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:40:59.421778 23818 raft_consensus.cc:2454] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:59.423548 23555 leader_election.cc:302] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:59.429163 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:59.429643 23821 raft_consensus.cc:2454] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
W20260807 13:40:59.421680 25232 log.cc:924] Time spent T 68ed0b32f1864122a6a9a014c0217c01 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.102s user 0.001s sys 0.000s
I20260807 13:40:59.421355 25190 raft_consensus.cc:3037] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:59.426514 25062 leader_election.cc:288] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:59.431506 25195 raft_consensus.cc:2781] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:40:59.444581 25092 leader_election.cc:288] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:59.446902 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:59.447769 23820 raft_consensus.cc:2454] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:59.430562 25200 leader_election.cc:288] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:59.435989 24739 leader_election.cc:288] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:59.453989 25237 log.cc:924] Time spent T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.075s user 0.000s sys 0.000s
I20260807 13:40:59.454396 25182 consensus_queue.cc:1035] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:40:59.456938 23807 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f8a5f186bf1473a988921e5efa3e574 with delete_type TABLET_DATA_DELETED (Replaced by 7a180725c9e34d0095ab423614678d88 at 2026-08-07 13:40:56 UTC) from {username='slave'} at 127.0.0.1:45346
I20260807 13:40:59.449800 25188 consensus_queue.cc:1035] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260807 13:40:59.469532 23689 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f8a5f186bf1473a988921e5efa3e574 with delete_type TABLET_DATA_DELETED (Replaced by 7a180725c9e34d0095ab423614678d88 at 2026-08-07 13:40:56 UTC) from {username='slave'} at 127.0.0.1:47664
I20260807 13:40:59.451558 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:59.470764 23814 raft_consensus.cc:2454] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:59.471095 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:59.471684 23700 raft_consensus.cc:3037] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:59.475100 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9552d42b445450691daef21fba4059a" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.475981 23709 raft_consensus.cc:2396] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 13:40:59.439934 25038 consensus_queue.cc:1035] T 92e077211c2d4b67b9560872e943322f P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.036s
I20260807 13:40:59.476970 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.478231 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.489420 23703 raft_consensus.cc:2396] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:40:59.489564 23772 leader_election.cc:302] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:59.479085 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.479846 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.480543 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.481431 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.478547 23448 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37954 (request call id 131) took 3934 ms. Trace:
I20260807 13:40:59.482028 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:40:59.483263 25235 log.cc:924] Time spent T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.067s user 0.001s sys 0.000s
I20260807 13:40:59.450724 25195 raft_consensus.cc:686] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:59.485539 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:59.487547 25197 leader_election.cc:288] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:40:59.490628 23707 raft_consensus.cc:2379] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 4: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:59.496852 23705 raft_consensus.cc:2454] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:59.492115 25200 consensus_queue.cc:1035] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260807 13:40:59.492270 25092 raft_consensus.cc:2781] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:40:59.499014 25092 raft_consensus.cc:482] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:59.433215 25004 consensus_queue.cc:1035] T 2133139b13ce49de9c5a382720699163 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260807 13:40:59.501235 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.550127 25092 raft_consensus.cc:3037] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:59.501549 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.555658 24888 raft_consensus.cc:504] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:59.561444 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.558506 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.493219 23772 leader_election.cc:302] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
W20260807 13:40:59.574457 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 81316.7us
I20260807 13:40:59.574496 23709 raft_consensus.cc:2396] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:40:59.575757 23772 leader_election.cc:302] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:59.502317 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:59.578926 23710 raft_consensus.cc:3037] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 4
I20260807 13:40:59.579082 23772 leader_election.cc:302] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:59.501856 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.580456 23772 leader_election.cc:302] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:59.504719 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:59.580996 23660 leader_election.cc:302] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:59.583614 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:59.584193 23820 raft_consensus.cc:3037] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:59.584348 23703 raft_consensus.cc:2379] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 4: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:40:59.584697 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.587939 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:59.588719 23711 raft_consensus.cc:2396] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:40:59.494527 23813 raft_consensus.cc:2379] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 4: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:59.590610 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:59.594190 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.595515 23702 raft_consensus.cc:3037] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:59.597880 23772 leader_election.cc:302] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:59.600343 23660 leader_election.cc:302] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:59.604012 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:59.604839 23711 raft_consensus.cc:2396] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:40:59.605085 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.605718 23707 raft_consensus.cc:2454] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:59.606523 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.608966 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f8a5f186bf1473a988921e5efa3e574" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.610598 23660 leader_election.cc:302] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:59.496171 25192 leader_election.cc:288] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:59.612931 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.613557 23711 raft_consensus.cc:2454] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:40:59.609769 23703 raft_consensus.cc:2454] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:40:59.614362 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:59.602337 25197 raft_consensus.cc:2781] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:59.617259 25197 raft_consensus.cc:482] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:59.617815 25197 raft_consensus.cc:3037] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:59.619139 23554 leader_election.cc:302] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:59.620111 23554 leader_election.cc:302] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:59.621174 23554 leader_election.cc:302] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:59.621716 25193 raft_consensus.cc:2781] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:59.621271 25062 raft_consensus.cc:2781] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:40:59.622575 25062 raft_consensus.cc:482] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:59.623024 25062 raft_consensus.cc:3037] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:59.623152 25158 raft_consensus.cc:2781] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:40:59.623898 25158 raft_consensus.cc:686] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:40:59.625130 25158 consensus_queue.cc:237] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:59.494094 25195 consensus_queue.cc:237] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:59.630697 23820 raft_consensus.cc:2454] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:59.623174 25007 raft_consensus.cc:504] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:59.577575 25025 raft_consensus.cc:2726] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:40:59.635501 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.634491 23554 leader_election.cc:302] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:59.634132 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:59.656905 23703 raft_consensus.cc:2362] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 4. Re-sending same reply.
I20260807 13:40:59.657858 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.659050 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.495041 23448 rpcz_store.cc:276] 0807 13:40:55.544267 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:55.571949 (+ 27682us) service_pool.cc:227] Handling call
0807 13:40:59.478462 (+3906513us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:40:59.401906 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:40:59.462832 (+ 60926us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:40:59.462873 (+ 41us) write_op.cc:435] Acquired schema lock
0807 13:40:59.462887 (+ 14us) tablet.cc:660] Decoding operations
0807 13:40:59.463529 (+ 642us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:40:59.463581 (+ 52us) write_op.cc:641] Partition lock acquired for write op
0807 13:40:59.463610 (+ 29us) tablet.cc:683] Acquiring locks for 4 operations
0807 13:40:59.464005 (+ 395us) tablet.cc:699] Row locks acquired
0807 13:40:59.464021 (+ 16us) write_op.cc:260] PREPARE: finished
0807 13:40:59.464177 (+ 156us) write_op.cc:270] Start()
0807 13:40:59.464304 (+ 127us) write_op.cc:276] Timestamp: P: 1786110059464131 usec, L: 0
0807 13:40:59.464321 (+ 17us) op_driver.cc:331] REPLICATION: starting
0807 13:40:59.464953 (+ 632us) log.cc:842] Serialized 1693 byte log entry
0807 13:40:59.467037 (+ 2084us) op_driver.cc:444] REPLICATION: finished
0807 13:40:59.469705 (+ 2668us) write_op.cc:301] APPLY: starting
0807 13:40:59.469831 (+ 126us) tablet.cc:1365] starting BulkCheckPresence
0807 13:40:59.470050 (+ 219us) tablet.cc:1368] finished BulkCheckPresence
0807 13:40:59.470235 (+ 185us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:40:59.470840 (+ 605us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:40:59.471071 (+ 231us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0807 13:40:59.471132 (+ 61us) write_op.cc:312] APPLY: finished
0807 13:40:59.471450 (+ 318us) log.cc:842] Serialized 40 byte log entry
0807 13:40:59.471639 (+ 189us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:40:59.471795 (+ 156us) write_op.cc:454] Released schema lock
0807 13:40:59.471847 (+ 52us) write_op.cc:341] FINISH: Updating metrics
0807 13:40:59.472123 (+ 276us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:40:59.472160 (+ 37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":831,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":2398,"apply.run_cpu_time_us":2775,"apply.run_wall_time_us":2775,"num_ops":4,"prepare.queue_time_us":93772,"prepare.run_cpu_time_us":3746,"prepare.run_wall_time_us":113479,"replication_time_us":2620,"thread_start_us":6839,"threads_started":1}]]}
I20260807 13:40:59.591895 23710 raft_consensus.cc:2454] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:40:59.663163 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.664592 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:59.665892 23710 raft_consensus.cc:2362] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3. Re-sending same reply.
I20260807 13:40:59.592694 25188 raft_consensus.cc:2781] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:40:59.656068 23660 leader_election.cc:302] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:59.593114 25182 raft_consensus.cc:2781] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260807 13:40:59.643882 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 46145us
I20260807 13:40:59.602272 25200 raft_consensus.cc:2781] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election won for term 4
@ 0x7f4618819df4 google::LogMessage::SendToLog() at ??:0
I20260807 13:40:59.632947 24888 leader_election.cc:288] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:59.669570 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:59.688969 23598 raft_consensus.cc:2354] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4.
I20260807 13:40:59.689296 23700 raft_consensus.cc:2454] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:40:59.689937 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:59.690461 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.670428 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.691566 23594 raft_consensus.cc:2354] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4.
I20260807 13:40:59.612186 24859 raft_consensus.cc:2781] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:40:59.660462 25193 raft_consensus.cc:686] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:59.692203 23585 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f8a5f186bf1473a988921e5efa3e574 with delete_type TABLET_DATA_DELETED (Replaced by 7a180725c9e34d0095ab423614678d88 at 2026-08-07 13:40:56 UTC) from {username='slave'} at 127.0.0.1:43804
I20260807 13:40:59.654621 24795 raft_consensus.cc:2781] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:40:59.694790 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.697645 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.698452 23594 raft_consensus.cc:2454] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:59.699489 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.700955 23660 leader_election.cc:302] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:59.683657 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:59.603850 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:59.603124 25171 raft_consensus.cc:2781] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:59.706604 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:59.612528 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:59.687733 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.658320 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:59.704332 23554 leader_election.cc:302] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:59.708560 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:59.709133 23710 raft_consensus.cc:2362] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3. Re-sending same reply.
I20260807 13:40:59.709201 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.709959 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.710279 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:59.710844 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:59.711320 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.711623 23594 raft_consensus.cc:2362] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 4. Re-sending same reply.
I20260807 13:40:59.712078 23709 raft_consensus.cc:2379] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 4: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:59.706509 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.714015 23704 raft_consensus.cc:2379] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 4: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:59.714736 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.715396 23704 raft_consensus.cc:2379] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 4: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:59.690862 23598 raft_consensus.cc:2354] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
I20260807 13:40:59.716971 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:59.717800 23598 raft_consensus.cc:2362] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4. Re-sending same reply.
I20260807 13:40:59.651162 23702 raft_consensus.cc:2454] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:40:59.677899 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.719079 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9552d42b445450691daef21fba4059a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.720278 23598 raft_consensus.cc:2379] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:59.702416 23703 raft_consensus.cc:2396] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:40:59.720855 23820 pending_rounds.cc:76] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697: Aborting all ops after (but not including) 2
I20260807 13:40:59.720809 23825 raft_consensus.cc:1261] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:40:59.708277 23600 raft_consensus.cc:2454] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:40:59.755069 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:59.758311 23823 raft_consensus.cc:2354] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4.
W20260807 13:40:59.757642 23555 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:43820 dropped due to backpressure. The service queue is full; it has 50 items.
I20260807 13:40:59.745947 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:59.724658 23554 leader_election.cc:302] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:59.760048 23818 raft_consensus.cc:2379] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 3: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:40:59.636399 25017 raft_consensus.cc:504] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:59.722190 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:40:59.761588 23820 pending_rounds.cc:97] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260807 13:40:59.763936 23820 raft_consensus.cc:2866] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:40:59.681833 25038 raft_consensus.cc:2781] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:40:59.685360 25182 raft_consensus.cc:482] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:59.686744 23590 raft_consensus.cc:2454] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
W20260807 13:40:59.767011 23535 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:40:59.703668 24795 raft_consensus.cc:482] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:59.681401 25188 raft_consensus.cc:482] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:59.685484 25200 raft_consensus.cc:482] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:59.704779 25209 raft_consensus.cc:2781] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:40:59.722421 25078 consensus_queue.cc:1035] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.048s
I20260807 13:40:59.762326 23700 raft_consensus.cc:2454] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:40:59.770771 25173 raft_consensus.cc:2726] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:59.770543 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:59.771543 25256 tablet_replica.cc:330] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812: stopping tablet replica
I20260807 13:40:59.721868 25211 raft_consensus.cc:2741] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260807 13:40:59.772984 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.758378 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.667080 25063 raft_consensus.cc:504] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:59.772639 25192 raft_consensus.cc:2781] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:40:59.766814 23554 leader_election.cc:302] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:59.770330 24795 raft_consensus.cc:3037] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:59.777232 25188 raft_consensus.cc:3037] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:59.703696 25171 raft_consensus.cc:482] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:40:59.743541 23814 raft_consensus.cc:3037] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:59.759286 25002 raft_consensus.cc:2781] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:40:59.742772 25208 consensus_queue.cc:1035] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260807 13:40:59.759150 23555 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:43820 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 685)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 584)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 602)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 603)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 686)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 687)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 688)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 689)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 604)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 690)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 691)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 583)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 578)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 577)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 605)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 576)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 606)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 607)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 572)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 582)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 574)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 570)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 580)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 581)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 573)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 585)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 587)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 588)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 589)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 590)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 591)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 593)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 595)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 596)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 597)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 598)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 599)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 600)
I20260807 13:40:59.692869 25193 consensus_queue.cc:237] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:59.693861 24859 raft_consensus.cc:482] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
W20260807 13:40:59.788319 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 104709us
I20260807 13:40:59.770479 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:40:59.769137 25182 raft_consensus.cc:3037] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:59.806707 23821 raft_consensus.cc:2354] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
I20260807 13:40:59.790134 23825 raft_consensus.cc:2354] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4.
I20260807 13:40:59.790526 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:59.809587 23710 raft_consensus.cc:2379] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 3: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:59.769968 25038 raft_consensus.cc:482] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:59.777877 25200 raft_consensus.cc:3037] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:59.796960 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:40:59.777770 25209 raft_consensus.cc:482] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:59.801929 23588 raft_consensus.cc:2379] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:59.723084 23699 raft_consensus.cc:3037] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:59.793412 25248 tablet_replica.cc:330] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37: stopping tablet replica
I20260807 13:40:59.761802 24853 raft_consensus.cc:504] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:59.819701 23807 tablet_service.cc:1467] Processing CreateTablet for tablet 7a180725c9e34d0095ab423614678d88 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260807 13:40:59.821581 25063 leader_election.cc:288] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:40:59.802580 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 96179.1us
I20260807 13:40:59.712556 24952 raft_consensus.cc:2781] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:40:59.798763 25171 raft_consensus.cc:3037] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:59.800542 24888 raft_consensus.cc:2781] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:40:59.795382 23554 leader_election.cc:302] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:59.820098 25017 leader_election.cc:288] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:59.799635 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.837674 23598 raft_consensus.cc:2354] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
I20260807 13:40:59.838766 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.839624 23598 raft_consensus.cc:2454] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 4.
I20260807 13:40:59.823836 23821 raft_consensus.cc:1261] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260807 13:40:59.841349 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 46076.7us
I20260807 13:40:59.842729 24739 raft_consensus.cc:2781] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:40:59.843132 24739 raft_consensus.cc:482] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:40:59.843551 24739 raft_consensus.cc:3037] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:59.809593 25002 raft_consensus.cc:686] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:59.821810 24853 leader_election.cc:288] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:59.816861 25209 raft_consensus.cc:3037] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:59.804931 24859 raft_consensus.cc:3037] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:59.810451 25038 raft_consensus.cc:3037] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:59.805217 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.802520 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:59.844357 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:59.855285 23598 raft_consensus.cc:2362] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4. Re-sending same reply.
I20260807 13:40:59.856442 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.857374 23598 raft_consensus.cc:2379] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 4: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:59.802255 25192 raft_consensus.cc:686] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:40:59.830176 24952 raft_consensus.cc:482] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:59.799289 25251 consensus_queue.cc:1035] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.050s
I20260807 13:40:59.838099 25007 leader_election.cc:288] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:40:59.837071 24888 raft_consensus.cc:482] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:40:59.817060 25062 raft_consensus.cc:504] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:59.859900 23555 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:43828 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 686)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 687)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 688)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 689)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 604)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 690)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 691)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 583)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 578)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 577)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 605)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 696)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 692)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 693)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 576)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 694)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 695)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 697)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 606)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 607)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 698)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 704)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 699)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 700)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 572)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 705)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 582)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 574)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 570)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 580)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 581)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 573)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 585)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 587)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 588)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 589)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 590)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 591)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 593)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 595)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 596)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 597)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 598)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 599)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 600)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 702)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 703)
I20260807 13:40:59.880295 25264 consensus_queue.cc:1046] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260807 13:40:59.882053 25249 log.cc:924] Time spent T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.079s user 0.000s sys 0.001s
W20260807 13:40:59.887130 25244 log.cc:924] Time spent T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.179s user 0.000s sys 0.001s
I20260807 13:40:59.895048 25192 consensus_queue.cc:237] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:40:59.866000 24952 raft_consensus.cc:3037] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:40:59.913127 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:40:59.915268 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 107973us
I20260807 13:40:59.918533 23662 leader_election.cc:398] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Vote denied by peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187) with higher term. Message: Invalid argument: T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4.
I20260807 13:40:59.918998 23662 leader_election.cc:401] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260807 13:40:59.919910 23662 leader_election.cc:302] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:40:59.920559 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:59.921192 23702 raft_consensus.cc:3037] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:40:59.922205 23662 leader_election.cc:398] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187) with higher term. Message: Invalid argument: T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4.
I20260807 13:40:59.922729 23662 leader_election.cc:401] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:40:59.924237 23662 leader_election.cc:398] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Vote denied by peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187) with higher term. Message: Invalid argument: T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
I20260807 13:40:59.924664 23662 leader_election.cc:401] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260807 13:40:59.927963 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "830e8cb8ce434e6391c09530c677a61d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:59.929124 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f8a5f186bf1473a988921e5efa3e574" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:59.929309 23555 leader_election.cc:302] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:59.930454 23555 leader_election.cc:302] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:59.931610 25158 raft_consensus.cc:2726] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187) with higher term. Message: Invalid argument: T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4.
I20260807 13:40:59.932374 23702 raft_consensus.cc:2454] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
W20260807 13:40:59.933496 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 114122us
I20260807 13:40:59.934168 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:59.934954 23702 raft_consensus.cc:3037] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:59.932905 25158 raft_consensus.cc:2726] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187) with higher term. Message: Invalid argument: T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
I20260807 13:40:59.922710 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c1184114b02410098331e68d3b8d4cf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:40:59.898744 24888 raft_consensus.cc:3037] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:40:59.869257 23590 raft_consensus.cc:2454] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
W20260807 13:40:59.872887 23705 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 675) took 2515 ms (client timeout 2094 ms). Trace:
I20260807 13:40:59.943562 23555 leader_election.cc:302] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:59.943851 23702 raft_consensus.cc:2454] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:40:59.944937 23555 leader_election.cc:302] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:59.946293 25017 raft_consensus.cc:2726] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:40:59.946475 23689 tablet_service.cc:1467] Processing CreateTablet for tablet 7a180725c9e34d0095ab423614678d88 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260807 13:40:59.947052 25017 raft_consensus.cc:2726] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:40:59.947752 25017 raft_consensus.cc:2726] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:59.948411 23689 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a180725c9e34d0095ab423614678d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:40:59.949860 23555 leader_election.cc:302] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:59.951435 23555 leader_election.cc:302] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:59.955101 23555 leader_election.cc:302] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:59.956705 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.957455 23601 raft_consensus.cc:2379] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 4: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:40:59.943671 25143 raft_consensus.cc:2726] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:40:59.959192 23555 leader_election.cc:302] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:40:59.961802 23555 leader_election.cc:302] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:59.937927 25070 raft_consensus.cc:2726] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:40:59.941499 24905 raft_consensus.cc:2726] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:40:59.941622 25007 raft_consensus.cc:2726] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187) with higher term. Message: Invalid argument: T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4.
I20260807 13:40:59.967512 23662 leader_election.cc:302] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:59.902438 25190 raft_consensus.cc:504] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:59.970865 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 54929.4us
I20260807 13:40:59.955869 25017 raft_consensus.cc:2726] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:40:59.969426 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:40:59.980995 23772 leader_election.cc:302] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:40:59.979084 23662 leader_election.cc:302] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:40:59.956255 25192 raft_consensus.cc:2726] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:40:59.956439 25259 consensus_queue.cc:1035] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.085s
I20260807 13:41:00.019104 25070 raft_consensus.cc:2781] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260807 13:41:00.193063 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 258591us
W20260807 13:41:00.194320 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 230902us
I20260807 13:41:00.248168 23555 leader_election.cc:302] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:40:59.973016 25269 raft_consensus.cc:2726] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:41:00.032842 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:40:59.964643 25002 consensus_queue.cc:237] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:40:59.943887 23705 rpcz_store.cc:269] 0807 13:40:57.357308 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:57.863892 (+506584us) service_pool.cc:227] Handling call
0807 13:40:59.859700 (+1995808us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b540035a7d4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:40:59.868736 (+ 9036us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":469469440}
I20260807 13:41:00.231935 23601 raft_consensus.cc:2362] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3. Re-sending same reply.
I20260807 13:40:59.961040 24853 raft_consensus.cc:2726] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 13:41:00.237007 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 258033us
I20260807 13:41:00.259609 23555 leader_election.cc:302] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:41:00.249337 23769 leader_election.cc:302] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:00.219686 25251 raft_consensus.cc:3032] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Stepping down as leader of term 3
W20260807 13:41:00.241523 25197 consensus_meta.cc:287] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.617s user 0.011s sys 0.008s
I20260807 13:41:00.235872 25208 raft_consensus.cc:2781] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election won for term 4
W20260807 13:41:00.247434 25092 consensus_meta.cc:287] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.654s user 0.012s sys 0.008s
I20260807 13:41:00.246574 25070 raft_consensus.cc:482] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:00.287648 23590 raft_consensus.cc:2354] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4.
I20260807 13:41:00.288574 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:00.267010 25251 raft_consensus.cc:729] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:00.328455 25209 raft_consensus.cc:504] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:00.328698 25251 consensus_queue.cc:260] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:00.329707 25251 raft_consensus.cc:3037] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:00.289670 25197 raft_consensus.cc:504] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:00.268740 23555 leader_election.cc:302] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:00.254716 25158 raft_consensus.cc:2781] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:41:00.331070 25158 raft_consensus.cc:482] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:41:00.331481 25158 raft_consensus.cc:3037] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:00.332311 25197 leader_election.cc:288] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:00.252693 25263 raft_consensus.cc:482] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:00.332767 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac6e18ecd14ba2a7d3e846a9fc81bf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:00.333040 25263 raft_consensus.cc:504] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:00.334190 23818 raft_consensus.cc:1226] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3. Ops: []
W20260807 13:41:00.334383 25200 consensus_meta.cc:287] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.515s user 0.001s sys 0.016s
I20260807 13:41:00.334800 25200 raft_consensus.cc:504] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:00.335199 25263 leader_election.cc:288] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:00.335551 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f8a5f186bf1473a988921e5efa3e574" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:00.336349 23599 raft_consensus.cc:2379] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:41:00.336755 25200 leader_election.cc:288] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:41:00.336944 25188 consensus_meta.cc:287] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.529s user 0.007s sys 0.009s
I20260807 13:41:00.256903 25253 consensus_queue.cc:1035] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.081s
I20260807 13:41:00.337357 25188 raft_consensus.cc:504] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:00.315443 25181 raft_consensus.cc:2781] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:41:00.338351 25181 raft_consensus.cc:482] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:41:00.338828 25181 raft_consensus.cc:3037] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:00.338507 24739 raft_consensus.cc:504] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:00.340055 23817 raft_consensus.cc:1226] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:00.340569 24739 leader_election.cc:288] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:00.341243 25171 raft_consensus.cc:504] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:00.342058 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:00.342983 23591 raft_consensus.cc:2396] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 for term 4 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 13:41:00.343279 23711 raft_consensus.cc:3037] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:41:00.343739 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:00.343832 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9552d42b445450691daef21fba4059a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:00.344511 23591 raft_consensus.cc:2454] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:41:00.344628 23815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 423) took 1128 ms. Trace:
I20260807 13:41:00.345196 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:00.317329 24859 raft_consensus.cc:504] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:00.318325 25062 leader_election.cc:288] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:00.345522 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c1184114b02410098331e68d3b8d4cf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:00.308131 23699 raft_consensus.cc:2454] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:41:00.346035 25192 raft_consensus.cc:2781] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:41:00.346491 23807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a180725c9e34d0095ab423614678d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:41:00.319116 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:00.349022 23823 raft_consensus.cc:1226] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4. Ops: []
W20260807 13:41:00.320379 24795 consensus_meta.cc:287] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent flushing consensus metadata: real 0.518s user 0.006s sys 0.006s
I20260807 13:41:00.325217 23588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43828 (request call id 657) took 1253 ms. Trace:
W20260807 13:41:00.326493 25260 log.cc:924] Time spent T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.086s user 0.000s sys 0.000s
I20260807 13:41:00.294564 25269 raft_consensus.cc:2726] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:00.333467 23594 raft_consensus.cc:2454] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:41:00.338719 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:00.341282 25070 raft_consensus.cc:3037] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:00.317807 24952 raft_consensus.cc:504] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:00.337147 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:00.321592 25182 raft_consensus.cc:504] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:00.317054 24888 raft_consensus.cc:504] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:00.352029 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:41:00.367460 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 98800.8us
I20260807 13:41:00.385684 23555 leader_election.cc:302] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:00.345765 25246 tablet_replica.cc:330] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697: stopping tablet replica
I20260807 13:41:00.396674 23598 raft_consensus.cc:2362] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 4. Re-sending same reply.
I20260807 13:41:00.397050 23599 raft_consensus.cc:2454] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 4.
I20260807 13:41:00.304371 23814 raft_consensus.cc:2454] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:41:00.399514 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:00.402056 23711 raft_consensus.cc:2454] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:41:00.417454 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:00.414883 23594 raft_consensus.cc:2454] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:41:00.419606 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:00.426599 23707 raft_consensus.cc:2379] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 2: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:41:00.365849 25192 raft_consensus.cc:686] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:41:00.376466 25208 raft_consensus.cc:686] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:00.345039 23815 rpcz_store.cc:276] 0807 13:40:59.215796 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:59.218086 (+ 2290us) service_pool.cc:227] Handling call
0807 13:40:59.305875 (+ 87789us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b5800255098. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f4620fef1b0 00007f4620feea94 00007f461a6d6c04 00007f461a6d6b92
0807 13:40:59.597945 (+292070us) spinlock_profiling.cc:243] Waited 6.67 ms on lock 0x7b5800255098. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914dbce 000000000034aea9 00007f4620f79a30 00007f462103f7b4 00007f462103f821 00007f4620fef1b0 00007f4620feea94 00007f461a6d6c04 00007f461a6d6b92
0807 13:41:00.343645 (+745700us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b5800255098. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914dc6c 00007f461914dbd6 000000000034aea9 00007f4620f79a30 00007f462103f7b4 00007f462103f821 00007f4620fef1b0 00007f4620feea94 00007f461a6d6c04 00007f461a6d6b92
0807 13:41:00.344570 (+ 925us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":57540480}
I20260807 13:41:00.379968 25062 raft_consensus.cc:2781] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:41:00.380448 25190 leader_election.cc:288] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:00.380661 25171 leader_election.cc:288] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:00.428795 23601 raft_consensus.cc:2362] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3. Re-sending same reply.
I20260807 13:41:00.453135 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:00.308437 25092 raft_consensus.cc:504] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:00.357036 25038 raft_consensus.cc:504] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:00.461093 23594 raft_consensus.cc:2379] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 3: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:41:00.415437 25197 raft_consensus.cc:2741] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260807 13:41:00.375636 24795 raft_consensus.cc:504] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:41:00.470059 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 220821us
I20260807 13:41:00.419239 25209 leader_election.cc:288] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:41:00.467080 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 486168us
I20260807 13:41:00.412724 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:00.398481 25284 raft_consensus.cc:2781] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:41:00.461262 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:00.476643 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:00.504372 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:00.462524 25062 raft_consensus.cc:686] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
W20260807 13:41:00.512998 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 246983us
I20260807 13:41:00.367012 23588 rpcz_store.cc:276] 0807 13:40:59.072163 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:59.144328 (+ 72165us) service_pool.cc:227] Handling call
0807 13:41:00.324916 (+1180588us) spinlock_profiling.cc:243] Waited 634 ms on lock 0x7b54002f4ed4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:41:00.325130 (+ 214us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1457631616}
I20260807 13:41:00.511484 23772 leader_election.cc:302] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:00.510764 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:00.507470 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:00.512511 23600 raft_consensus.cc:2379] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 4: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:41:00.476902 23598 raft_consensus.cc:2362] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3. Re-sending same reply.
I20260807 13:41:00.524147 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:00.525571 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:00.526206 23598 raft_consensus.cc:2454] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:41:00.527139 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:00.516665 23594 raft_consensus.cc:2354] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
I20260807 13:41:00.520335 23769 leader_election.cc:302] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:41:00.521013 23662 leader_election.cc:398] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187) with higher term. Message: Invalid argument: T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
I20260807 13:41:00.529865 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:00.530174 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:00.532712 23772 leader_election.cc:302] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:00.534379 23662 leader_election.cc:302] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:41:00.535290 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:00.536566 23662 leader_election.cc:398] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187) with higher term. Message: Invalid argument: T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4.
I20260807 13:41:00.531195 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:00.539489 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:41:00.542091 23660 leader_election.cc:334] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Timed out: RequestConsensusVote RPC to 127.21.82.67:46685 timed out after 1.500s (SENT)
I20260807 13:41:00.508055 25188 leader_election.cc:288] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:00.519830 25284 raft_consensus.cc:686] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:41:00.547892 23598 raft_consensus.cc:1226] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4. Ops: []
W20260807 13:41:00.554436 25281 log.cc:924] Time spent T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.101s user 0.000s sys 0.000s
I20260807 13:41:00.510716 23590 raft_consensus.cc:2454] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:41:00.552986 25257 raft_consensus.cc:482] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:41:00.535579 23813 raft_consensus.cc:1226] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:00.553390 25033 raft_consensus.cc:482] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:41:00.553746 24888 leader_election.cc:288] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:00.581453 25248 raft_consensus.cc:2229] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:41:00.581707 25038 leader_election.cc:288] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:00.581946 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:00.582211 25248 raft_consensus.cc:2258] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:41:00.546090 25273 raft_consensus.cc:2781] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:00.582684 23591 raft_consensus.cc:2454] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:00.583055 25273 raft_consensus.cc:482] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:00.583487 25273 raft_consensus.cc:3037] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:00.584291 23591 raft_consensus.cc:1261] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:41:00.560546 25209 raft_consensus.cc:482] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:00.585126 25209 raft_consensus.cc:504] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:00.585741 23591 pending_rounds.cc:76] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812: Aborting all ops after (but not including) 1
I20260807 13:41:00.586087 23591 pending_rounds.cc:97] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260807 13:41:00.586374 23591 raft_consensus.cc:2866] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:41:00.555599 25092 leader_election.cc:288] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:00.556762 25182 leader_election.cc:288] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:00.549587 23595 raft_consensus.cc:2354] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4.
I20260807 13:41:00.552057 23772 leader_election.cc:302] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:00.553196 25246 raft_consensus.cc:2229] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:41:00.563951 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:00.641405 23711 raft_consensus.cc:3037] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:41:00.567250 23662 leader_election.cc:302] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
W20260807 13:41:00.645977 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 78818.2us
I20260807 13:41:00.646975 23662 leader_election.cc:302] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:41:00.568291 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
W20260807 13:41:00.568977 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 178093us
I20260807 13:41:00.569983 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:00.544806 24905 raft_consensus.cc:2781] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:00.554736 25192 consensus_queue.cc:237] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:00.588006 24952 leader_election.cc:288] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:00.578810 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:00.580694 23555 leader_election.cc:302] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:00.582595 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:00.594048 23769 leader_election.cc:302] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
W20260807 13:41:00.597146 23660 leader_election.cc:334] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Timed out: RequestConsensusVote RPC to 127.21.82.67:46685 timed out after 1.553s (SENT)
I20260807 13:41:00.631681 25256 raft_consensus.cc:2229] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260807 13:41:00.640812 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 88826us
I20260807 13:41:00.653927 23772 leader_election.cc:302] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:00.546438 25208 consensus_queue.cc:237] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:00.607038 23598 raft_consensus.cc:1226] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:00.607060 25171 raft_consensus.cc:482] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:41:00.607717 25273 raft_consensus.cc:504] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:00.550730 24859 leader_election.cc:288] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:00.549674 25263 raft_consensus.cc:482] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:00.546835 25298 raft_consensus.cc:2781] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:41:00.558810 25253 raft_consensus.cc:2781] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:41:00.549448 25266 consensus_queue.cc:1035] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.076s
I20260807 13:41:00.651136 23662 leader_election.cc:302] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:00.656870 25078 raft_consensus.cc:2781] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260807 13:41:00.797503 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 146442us
I20260807 13:41:00.798709 23662 leader_election.cc:398] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187) with higher term. Message: Invalid argument: T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
I20260807 13:41:00.799714 23662 leader_election.cc:302] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:00.801083 23662 leader_election.cc:302] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
W20260807 13:41:00.653127 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 56026.3us
I20260807 13:41:00.727566 25092 raft_consensus.cc:2726] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 13:41:00.654865 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 74264.9us
W20260807 13:41:00.778278 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 124454us
I20260807 13:41:00.649384 24905 raft_consensus.cc:482] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:41:00.656925 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 62958us
I20260807 13:41:00.592175 25033 raft_consensus.cc:504] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:00.655562 25038 raft_consensus.cc:2781] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:41:00.667870 25284 consensus_queue.cc:237] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:00.785907 23711 raft_consensus.cc:2454] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
W20260807 13:41:00.667299 25295 log.cc:924] Time spent T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.135s user 0.003s sys 0.000s
W20260807 13:41:00.663749 25276 log.cc:924] Time spent T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.134s user 0.000s sys 0.001s
I20260807 13:41:00.655040 25182 raft_consensus.cc:2781] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:41:00.652989 25007 raft_consensus.cc:2726] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:41:00.656034 25246 raft_consensus.cc:2258] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:41:00.579622 25257 raft_consensus.cc:504] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:41:00.802919 23660 leader_election.cc:334] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Timed out: RequestConsensusVote RPC to 127.21.82.67:46685 timed out after 1.629s (SENT)
I20260807 13:41:00.792086 25262 raft_consensus.cc:2781] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:41:00.841567 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:00.859225 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:00.861557 23772 leader_election.cc:302] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:00.862501 23769 leader_election.cc:302] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
W20260807 13:41:00.868739 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 65854.1us
I20260807 13:41:00.602808 25209 leader_election.cc:288] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:00.857897 24795 leader_election.cc:288] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:00.833837 24952 raft_consensus.cc:2726] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:41:00.888506 23555 leader_election.cc:302] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:00.804540 23662 leader_election.cc:302] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:00.795202 25256 raft_consensus.cc:2258] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:41:00.793447 25298 raft_consensus.cc:482] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:00.890295 23700 raft_consensus.cc:3037] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:00.901463 23598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 587) took 1225 ms. Trace:
I20260807 13:41:00.789911 25171 raft_consensus.cc:504] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:00.856954 25211 raft_consensus.cc:2726] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:00.864148 23588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 593) took 1186 ms. Trace:
I20260807 13:41:00.634991 25062 consensus_queue.cc:237] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:41:00.893296 23660 leader_election.cc:334] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Timed out: RequestConsensusVote RPC to 127.21.82.67:46685 timed out after 1.680s (SENT)
I20260807 13:41:00.857400 24905 raft_consensus.cc:3037] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Advancing to term 5
W20260807 13:41:00.907941 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 46486.2us
I20260807 13:41:00.803336 25078 raft_consensus.cc:482] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:00.857618 23590 raft_consensus.cc:1261] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:41:00.903352 23598 rpcz_store.cc:276] 0807 13:40:59.675525 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:00.559749 (+884224us) service_pool.cc:227] Handling call
0807 13:41:00.606784 (+ 47035us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:41:00.788653 (+181869us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:00.901229 (+112576us) spinlock_profiling.cc:243] Waited 46.6 ms on lock 0x7b54002549d0. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0aca09 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:41:00.901394 (+ 165us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":107207552}
W20260807 13:41:00.903724 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 99246.4us
I20260807 13:41:00.864010 25182 raft_consensus.cc:482] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:41:00.864148 25271 raft_consensus.cc:2726] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:41:00.796551 25253 raft_consensus.cc:482] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:41:00.910717 25033 leader_election.cc:288] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:00.895828 25092 raft_consensus.cc:2781] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:41:00.911477 23813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45360 (request call id 616) took 1205 ms. Trace:
I20260807 13:41:00.911597 23807 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45346 (request call id 60) took 1226 ms. Trace:
I20260807 13:41:00.916803 23662 leader_election.cc:302] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:41:00.872901 25038 raft_consensus.cc:686] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
W20260807 13:41:00.917882 23535 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:41:00.915894 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:00.954988 23598 raft_consensus.cc:2454] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:00.955067 23662 leader_election.cc:302] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:41:00.913461 25209 raft_consensus.cc:2726] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:00.926410 23700 raft_consensus.cc:2454] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:41:00.928524 23769 leader_election.cc:302] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:00.895805 25262 raft_consensus.cc:686] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:00.802521 25263 raft_consensus.cc:504] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:00.947149 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 420) took 1027 ms. Trace:
W20260807 13:41:00.919211 25181 consensus_meta.cc:287] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.580s user 0.009s sys 0.002s
W20260807 13:41:00.910877 25293 log.cc:924] Time spent T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.377s user 0.000s sys 0.009s
I20260807 13:41:00.908865 25017 raft_consensus.cc:482] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:41:00.796943 23585 tablet_service.cc:1467] Processing CreateTablet for tablet 7a180725c9e34d0095ab423614678d88 (DEFAULT_TABLE table=test-workload [id=14f16c1129ee464da3f6afb00584355d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
W20260807 13:41:00.960999 25306 log.cc:924] Time spent T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.065s user 0.000s sys 0.001s
I20260807 13:41:00.920410 24795 raft_consensus.cc:2781] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:41:00.920266 25259 consensus_queue.cc:1035] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
W20260807 13:41:00.980990 23558 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.003s user 0.010s sys 0.017s
I20260807 13:41:01.015316 25017 raft_consensus.cc:504] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.016746 24795 raft_consensus.cc:686] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:41:01.017858 24795 consensus_queue.cc:237] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.023036 23585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a180725c9e34d0095ab423614678d88. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 13:41:01.022876 23769 raft_consensus.cc:2670] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260807 13:41:01.023964 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 95523.1us
I20260807 13:41:01.024821 23769 leader_election.cc:302] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:01.027086 23600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 590) took 1349 ms. Trace:
I20260807 13:41:01.027592 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 425) took 1106 ms. Trace:
I20260807 13:41:01.027515 23600 rpcz_store.cc:276] 0807 13:40:59.677160 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:00.602312 (+925152us) service_pool.cc:227] Handling call
0807 13:41:00.602778 (+ 466us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:41:00.603225 (+ 447us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:41:00.603264 (+ 39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:41:00.603826 (+ 562us) log.cc:842] Serialized 26 byte log entry
0807 13:41:00.782946 (+179120us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:41:00.864790 (+ 81844us) log.cc:842] Serialized 14 byte log entry
0807 13:41:00.888500 (+ 23710us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:00.888582 (+ 82us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:41:01.026837 (+138255us) raft_consensus.cc:1671] finished
0807 13:41:01.026861 (+ 24us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:41:01.027024 (+ 163us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":23438,"raft.queue_time_us":25659,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":156,"spinlock_wait_cycles":5611264,"thread_start_us":159574,"threads_started":2,"wal-append.queue_time_us":198790}
I20260807 13:41:00.988306 23555 leader_election.cc:302] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:00.956238 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9552d42b445450691daef21fba4059a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:00.915041 25078 raft_consensus.cc:3037] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:00.919189 25182 raft_consensus.cc:3037] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:00.919106 24888 raft_consensus.cc:482] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:41:00.980693 24952 consensus_queue.cc:1035] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260807 13:41:00.925734 25211 consensus_queue.cc:1046] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.083s
I20260807 13:41:00.907641 25298 raft_consensus.cc:3037] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:00.923295 25253 raft_consensus.cc:3037] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:00.924093 25264 raft_consensus.cc:2781] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:00.985826 23703 rpcz_store.cc:276] 0807 13:40:59.919485 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:59.921133 (+ 1648us) service_pool.cc:227] Handling call
0807 13:40:59.921453 (+ 320us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:59.921652 (+ 199us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:59.921674 (+ 22us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:40:59.942674 (+ 21000us) log.cc:842] Serialized 26 byte log entry
0807 13:41:00.044758 (+102084us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:41:00.506874 (+462116us) log.cc:842] Serialized 14 byte log entry
0807 13:41:00.510560 (+ 3686us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:00.510686 (+ 126us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:41:00.589031 (+ 78345us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b44000232cc. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f4619097a95 00007f46190984b2 00007f461bd40511 00007f461bd3be1a 00007f461bd2fbee 00007f461bd2ef36 00007f461bd2eb58 00007f461bd38551 00007f461bd38509 00007f461bd38499
0807 13:41:00.923615 (+334584us) raft_consensus.cc:1671] finished
0807 13:41:00.946854 (+ 23239us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:41:00.947073 (+ 219us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":255861,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":2396,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":8235,"spinlock_wait_cycles":24599808,"thread_start_us":308309,"threads_started":2,"wal-append.queue_time_us":475854}
I20260807 13:41:01.032621 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:01.040280 23700 raft_consensus.cc:2454] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:41:01.040431 23707 raft_consensus.cc:1261] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:41:01.026505 23769 leader_election.cc:302] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:00.981264 25308 tablet_bootstrap.cc:492] T 7a180725c9e34d0095ab423614678d88 P d28e736aee9f4f01b013de670a762697: Bootstrap starting.
I20260807 13:41:01.045976 23555 leader_election.cc:302] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:01.031363 23598 raft_consensus.cc:3037] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:41:01.028234 23704 rpcz_store.cc:276] 0807 13:40:59.921014 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:59.938165 (+ 17151us) service_pool.cc:227] Handling call
0807 13:40:59.938469 (+ 304us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:40:59.938804 (+ 335us) raft_consensus.cc:1520] Early marking committed up to index 2
0807 13:41:00.102170 (+163366us) log.cc:842] Serialized 14 byte log entry
0807 13:41:00.511147 (+408977us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:41:00.511628 (+ 481us) log.cc:842] Serialized 26 byte log entry
0807 13:41:00.511762 (+ 134us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:41:00.524423 (+ 12661us) log.cc:842] Serialized 14 byte log entry
0807 13:41:00.524672 (+ 249us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:00.524863 (+ 191us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:41:00.600837 (+ 75974us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b4800160158. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4620f547f1 00007f4620f4b8e7 00007f4620f4b77a 00007f462103f95f 00007f462103f627 00007f4621053b2c 00007f4621053ad8 00007f4621053a58 00007f4621053a13 00007f4621052cbc 00007f461ffd4be6
0807 13:41:00.910250 (+309413us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b44000232cc. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f4619097a95 00007f46190984b2 00007f461bd40511 00007f461bd3be1a 00007f461bd2fbee 00007f461bd2ef36 00007f461bd2eb58 00007f461bd38551 00007f461bd38509 00007f461bd38499
0807 13:41:01.027317 (+117067us) raft_consensus.cc:1671] finished
0807 13:41:01.027347 (+ 30us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:41:01.027521 (+ 174us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":40761,"prepare.queue_time_us":393853,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":2984,"raft.queue_time_us":22434,"raft.run_cpu_time_us":2836,"raft.run_wall_time_us":74959,"spinlock_wait_cycles":38300672,"thread_start_us":338716,"threads_started":2,"wal-append.queue_time_us":285854}
I20260807 13:41:00.981571 25007 raft_consensus.cc:2781] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:41:01.018327 25017 leader_election.cc:288] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:00.962848 25033 raft_consensus.cc:2781] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:01.077761 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:00.989105 25290 raft_consensus.cc:482] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:01.096428 23598 raft_consensus.cc:2454] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:41:01.105818 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f8a5f186bf1473a988921e5efa3e574" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
W20260807 13:41:01.093845 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 67304.2us
I20260807 13:41:00.971668 23590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 591) took 1280 ms. Trace:
I20260807 13:41:01.107721 23598 raft_consensus.cc:1261] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260807 13:41:01.015405 23558 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.038s user 0.011s sys 0.017s
I20260807 13:41:01.108819 23769 leader_election.cc:302] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:00.996724 25301 tablet_bootstrap.cc:492] T 7a180725c9e34d0095ab423614678d88 P 8a3af1d071e74f2eb0c821e2bd68fe37: Bootstrap starting.
I20260807 13:41:01.033313 25092 raft_consensus.cc:482] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:01.010780 25271 consensus_queue.cc:1046] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.191s
W20260807 13:41:01.202852 25305 log.cc:924] Time spent T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.221s user 0.000s sys 0.001s
I20260807 13:41:01.204838 25248 ts_tablet_manager.cc:1905] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 13:41:01.206725 25273 leader_election.cc:288] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:01.153921 25017 consensus_queue.cc:1035] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260807 13:41:00.996860 25181 raft_consensus.cc:504] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.206868 25262 consensus_queue.cc:237] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.207659 25171 leader_election.cc:288] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:01.208105 25256 ts_tablet_manager.cc:1905] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 13:41:01.041355 23813 rpcz_store.cc:276] 0807 13:40:59.706528 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:59.707853 (+ 1325us) service_pool.cc:227] Handling call
0807 13:40:59.775072 (+ 67219us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:41:00.579927 (+804855us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:00.911202 (+331275us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b54001f9d54. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:41:00.911409 (+ 207us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1693980928}
I20260807 13:41:01.201131 23598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 595) took 1522 ms. Trace:
I20260807 13:41:01.282517 23598 rpcz_store.cc:276] 0807 13:40:59.678328 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:01.107107 (+1428779us) service_pool.cc:227] Handling call
0807 13:41:01.107385 (+ 278us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:41:01.200838 (+ 93453us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:01.201074 (+ 236us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:41:01.284693 23598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 597) took 1605 ms. Trace:
I20260807 13:41:01.285195 23598 rpcz_store.cc:276] 0807 13:40:59.678837 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:01.283555 (+1604718us) service_pool.cc:227] Handling call
0807 13:41:01.284014 (+ 459us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:41:01.284245 (+ 231us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:41:01.284297 (+ 52us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:41:01.284357 (+ 60us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:41:01.284403 (+ 46us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:01.284476 (+ 73us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:41:01.284619 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:41:01.212553 25182 raft_consensus.cc:504] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.215899 25038 consensus_queue.cc:237] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.260043 25092 raft_consensus.cc:3037] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
W20260807 13:41:01.280746 25158 consensus_meta.cc:287] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.949s user 0.009s sys 0.007s
I20260807 13:41:01.229200 25257 leader_election.cc:288] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:41:01.237689 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 111196us
I20260807 13:41:01.080014 25211 consensus_queue.cc:1225] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer 08757cfbeffb41bbab14c2ef00e9d812 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260807 13:41:01.044143 25264 raft_consensus.cc:482] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
W20260807 13:41:01.106289 25276 log.cc:924] Time spent T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.078s user 0.000s sys 0.000s
I20260807 13:41:01.094504 25269 raft_consensus.cc:2781] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260807 13:41:01.174221 25296 log.cc:924] Time spent T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.112s user 0.001s sys 0.000s
W20260807 13:41:01.250156 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 268981us
I20260807 13:41:01.280115 25271 raft_consensus.cc:3032] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:41:01.319106 23662 leader_election.cc:302] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:01.111608 25291 raft_consensus.cc:2781] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:41:01.094786 25007 raft_consensus.cc:482] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:41:01.060125 25197 raft_consensus.cc:2781] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:41:01.081840 25280 raft_consensus.cc:2781] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election won for term 4
W20260807 13:41:01.258726 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 349684us
W20260807 13:41:01.244535 25070 consensus_meta.cc:287] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent flushing consensus metadata: real 0.832s user 0.012s sys 0.002s
W20260807 13:41:01.259325 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 150570us
I20260807 13:41:01.261133 23597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 585) took 1586 ms. Trace:
I20260807 13:41:00.914072 23588 rpcz_store.cc:276] 0807 13:40:59.677864 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:00.663890 (+986026us) service_pool.cc:227] Handling call
0807 13:41:00.666988 (+ 3098us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:41:00.667257 (+ 269us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:41:00.669757 (+ 2500us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:41:00.788227 (+118470us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:41:00.792808 (+ 4581us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:00.829721 (+ 36913us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:41:00.859474 (+ 29753us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:41:01.277616 23600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 596) took 1599 ms. Trace:
I20260807 13:41:01.315191 25264 raft_consensus.cc:3037] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:01.288959 23598 raft_consensus.cc:1261] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:41:01.226426 25263 leader_election.cc:288] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:01.191798 23590 rpcz_store.cc:276] 0807 13:40:59.677390 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:00.622211 (+944821us) service_pool.cc:227] Handling call
0807 13:41:00.654281 (+ 32070us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:41:00.917004 (+262723us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:00.951687 (+ 34683us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:41:01.109863 25033 raft_consensus.cc:482] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:41:01.119509 25290 raft_consensus.cc:504] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:41:01.297864 23554 leader_election.cc:334] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Timed out: RequestConsensusVote RPC to 127.21.82.67:46685 timed out after 1.878s (SENT)
I20260807 13:41:01.269657 25259 raft_consensus.cc:2781] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:41:01.344794 23598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 598) took 1665 ms. Trace:
I20260807 13:41:01.346370 23554 leader_election.cc:302] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:41:01.060509 24888 raft_consensus.cc:504] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.346931 23598 rpcz_store.cc:276] 0807 13:40:59.679238 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:01.286468 (+1607230us) service_pool.cc:227] Handling call
0807 13:41:01.288586 (+ 2118us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:41:01.344407 (+ 55821us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:01.344716 (+ 309us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:41:01.308161 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:00.950917 23807 rpcz_store.cc:276] 0807 13:40:59.684868 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:59.687023 (+ 2155us) service_pool.cc:227] Handling call
0807 13:41:00.345762 (+658739us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:41:00.345875 (+ 113us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:41:00.587624 (+241749us) tablet_metadata.cc:641] Metadata flushed
0807 13:41:00.649239 (+ 61615us) tablet_replica.cc:205] Creating consensus instance
0807 13:41:00.911419 (+262180us) inbound_call.cc:173] Queueing success response
0807 13:41:00.961539 (+ 50120us) ts_tablet_manager.cc:1373] Bootstrapping tablet
Metrics: {"tablet-open.queue_time_us":293976,"thread_start_us":219488,"threads_started":1}
I20260807 13:41:01.318495 25269 raft_consensus.cc:482] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:41:01.340996 23600 rpcz_store.cc:276] 0807 13:40:59.678549 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:01.178983 (+1500434us) service_pool.cc:227] Handling call
0807 13:41:01.276912 (+ 97929us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:41:01.277163 (+ 251us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:41:01.277206 (+ 43us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:41:01.277260 (+ 54us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:41:01.277304 (+ 44us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:01.277380 (+ 76us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:41:01.277532 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:41:01.335323 25007 raft_consensus.cc:3037] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
W20260807 13:41:01.347730 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 49925.8us
I20260807 13:41:01.348131 23598 raft_consensus.cc:1226] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:01.363197 23772 leader_election.cc:302] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:01.363648 23598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 600) took 1683 ms. Trace:
I20260807 13:41:01.364199 23598 rpcz_store.cc:276] 0807 13:40:59.679788 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:01.347663 (+1667875us) service_pool.cc:227] Handling call
0807 13:41:01.347974 (+ 311us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:41:01.363300 (+ 15326us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:01.363575 (+ 275us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:41:01.364840 23772 leader_election.cc:302] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:01.303534 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:01.365892 23599 raft_consensus.cc:2454] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:01.366575 23599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 570) took 1695 ms. Trace:
I20260807 13:41:01.348778 25033 raft_consensus.cc:3037] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:01.350064 23709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 421) took 1430 ms. Trace:
I20260807 13:41:01.325816 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f8a5f186bf1473a988921e5efa3e574" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:01.319212 25271 raft_consensus.cc:729] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:01.334941 25211 raft_consensus.cc:2781] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:01.343120 25291 raft_consensus.cc:686] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:01.342576 23769 leader_election.cc:302] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:01.345777 25280 raft_consensus.cc:686] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:41:01.343657 25316 raft_consensus.cc:482] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:41:01.345927 25197 raft_consensus.cc:686] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:01.342139 25070 raft_consensus.cc:504] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.355872 23600 raft_consensus.cc:1226] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:41:01.387259 23600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 702) took 1549 ms. Trace:
I20260807 13:41:01.387717 23600 rpcz_store.cc:276] 0807 13:40:59.837765 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:01.353399 (+1515634us) service_pool.cc:227] Handling call
0807 13:41:01.355609 (+ 2210us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:41:01.386914 (+ 31305us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:01.387189 (+ 275us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:41:01.367026 23599 rpcz_store.cc:276] 0807 13:40:59.671260 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:00.573582 (+902322us) service_pool.cc:227] Handling call
0807 13:41:01.303331 (+729749us) spinlock_profiling.cc:243] Waited 5.54 ms on lock 0x7b5800001898. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f4620fef1b0 00007f4620feea94 00007f461a6d6c04 00007f461a6d6b92
0807 13:41:01.366498 (+ 63167us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":12733184}
W20260807 13:41:01.390579 23660 leader_election.cc:334] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Timed out: RequestConsensusVote RPC to 127.21.82.67:46685 timed out after 2.130s (SENT)
I20260807 13:41:01.391093 23660 leader_election.cc:302] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:01.362636 25269 raft_consensus.cc:3037] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:41:01.301851 25158 raft_consensus.cc:504] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.370904 23709 rpcz_store.cc:276] 0807 13:40:59.919827 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:59.922004 (+ 2177us) service_pool.cc:227] Handling call
0807 13:40:59.922306 (+ 302us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:40:59.980014 (+ 57708us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:40:59.980061 (+ 47us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:40:59.980818 (+ 757us) log.cc:842] Serialized 52 byte log entry
0807 13:41:00.476259 (+495441us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:41:00.523821 (+ 47562us) log.cc:842] Serialized 14 byte log entry
0807 13:41:00.524200 (+ 379us) log.cc:842] Serialized 14 byte log entry
0807 13:41:00.524350 (+ 150us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:00.992072 (+467722us) spinlock_profiling.cc:243] Waited 57.2 ms on lock 0x7b5400070b54. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:41:00.992145 (+ 73us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:41:01.012715 (+ 20570us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b18002e5580. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f46220248b1 00007f4622031661 00007f4619185638 00007f4619188b11 00007f4619188ac9 00007f4619188a59 00007f4619188a21 00007f4619187d1d 00007f46223e9204 00007f46223e9039 00007f4619167dc6
0807 13:41:01.317827 (+305112us) spinlock_profiling.cc:243] Waited 9.5 ms on lock 0x7b18002e5580. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f46220248b1 00007f4622031661 00007f4619152f96 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4620f547f1 00007f4620f4b8e7 00007f4620f4b77a 00007f462103f95f
0807 13:41:01.349838 (+ 32011us) raft_consensus.cc:1671] finished
0807 13:41:01.349858 (+ 20us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:41:01.350001 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8158,"prepare.queue_time_us":122070,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":100,"raft.queue_time_us":13637,"raft.run_cpu_time_us":380,"raft.run_wall_time_us":29454,"spinlock_wait_cycles":185030400,"thread_start_us":227905,"threads_started":1,"wal-append.queue_time_us":500215}
I20260807 13:41:01.412200 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:01.413808 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:01.382966 23594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 581) took 1709 ms. Trace:
I20260807 13:41:01.392364 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:01.394855 23554 leader_election.cc:302] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:41:01.396620 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:01.398394 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:01.417217 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:01.401146 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:01.369204 23772 leader_election.cc:302] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:01.373337 24859 raft_consensus.cc:2726] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:01.415307 23594 rpcz_store.cc:276] 0807 13:40:59.673930 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:01.325448 (+1651518us) service_pool.cc:227] Handling call
0807 13:41:01.382893 (+ 57445us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:41:01.377755 25286 raft_consensus.cc:2726] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:01.428267 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:01.429744 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:01.422259 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:01.373167 25259 raft_consensus.cc:686] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:01.378346 25211 raft_consensus.cc:482] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:41:01.433216 23429 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 46855.4us
I20260807 13:41:01.434511 25273 raft_consensus.cc:2726] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:01.460564 23600 raft_consensus.cc:1226] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 LEADER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:41:01.460717 23707 raft_consensus.cc:1226] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:41:01.400136 25263 raft_consensus.cc:2726] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 13:41:01.426929 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 57834.3us
I20260807 13:41:01.465453 23772 leader_election.cc:302] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:01.467684 23707 raft_consensus.cc:1226] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:01.469672 25208 raft_consensus.cc:482] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:01.470316 25208 raft_consensus.cc:504] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.471498 25286 raft_consensus.cc:2726] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:41:01.397470 25316 raft_consensus.cc:504] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.473244 23772 leader_election.cc:302] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:01.475019 23772 leader_election.cc:302] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
W20260807 13:41:01.462833 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 392215us
I20260807 13:41:01.400527 25062 raft_consensus.cc:2726] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:01.418963 25188 raft_consensus.cc:2781] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:41:01.399534 25171 consensus_queue.cc:1035] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.068s
I20260807 13:41:01.458823 25211 raft_consensus.cc:3037] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:01.479373 23772 leader_election.cc:302] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:01.457487 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9552d42b445450691daef21fba4059a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:01.498163 23772 leader_election.cc:302] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:01.428380 24952 consensus_queue.cc:1035] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.055s
I20260807 13:41:01.473830 24795 raft_consensus.cc:2726] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:01.482050 25286 raft_consensus.cc:2726] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:41:01.526016 23707 raft_consensus.cc:1261] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:41:01.482671 25188 raft_consensus.cc:482] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:01.494930 25266 raft_consensus.cc:2781] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:41:01.494943 23588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 599) took 1803 ms. Trace:
I20260807 13:41:01.505601 24859 raft_consensus.cc:2781] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:41:01.538421 23772 leader_election.cc:302] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:01.514739 25286 raft_consensus.cc:482] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
W20260807 13:41:01.534103 24905 consensus_meta.cc:287] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.623s user 0.013s sys 0.000s
W20260807 13:41:01.547577 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 147867us
I20260807 13:41:01.517037 25263 raft_consensus.cc:482] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:01.539423 23699 raft_consensus.cc:2354] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 for earlier term 2. Current term is 3.
I20260807 13:41:01.533439 25181 leader_election.cc:288] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:01.536957 25188 raft_consensus.cc:3037] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:01.556708 25266 raft_consensus.cc:686] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:01.546123 23705 raft_consensus.cc:1261] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:41:01.557999 25266 consensus_queue.cc:237] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.536106 25182 leader_election.cc:288] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:01.540958 25208 leader_election.cc:288] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:01.541989 24859 raft_consensus.cc:482] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:41:01.528173 25033 raft_consensus.cc:504] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.555259 25263 raft_consensus.cc:504] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.551805 24905 raft_consensus.cc:504] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:41:01.579842 25327 log.cc:924] Time spent T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.078s user 0.000s sys 0.000s
I20260807 13:41:01.581696 25263 leader_election.cc:288] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:01.581976 25182 raft_consensus.cc:2781] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:41:01.495472 25291 consensus_queue.cc:237] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.495261 25280 consensus_queue.cc:237] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.511999 25197 consensus_queue.cc:237] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.562139 24888 leader_election.cc:288] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
@ 0x7f461881a9a0 google::LogMessage::Flush() at ??:0
I20260807 13:41:01.535723 23588 rpcz_store.cc:276] 0807 13:40:59.679515 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:01.348504 (+1668989us) service_pool.cc:227] Handling call
0807 13:41:01.401687 (+ 53183us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:41:01.439089 (+ 37402us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:41:01.457294 (+ 18205us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:41:01.461971 (+ 4677us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:41:01.466560 (+ 4589us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:01.474157 (+ 7597us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:41:01.482607 (+ 8450us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:41:01.669765 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:01.672614 23598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 707) took 1793 ms. Trace:
I20260807 13:41:01.679328 23599 raft_consensus.cc:1261] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:41:01.563233 23700 raft_consensus.cc:1261] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:41:01.727528 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:01.732071 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4062e0223a4cc0b2e448e35445671d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:01.733269 23599 raft_consensus.cc:2454] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 1.
I20260807 13:41:01.693264 23710 raft_consensus.cc:1226] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 13:41:01.693674 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:01.582000 24905 leader_election.cc:288] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:01.740193 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:41:01.742578 23595 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 565) took 2072 ms (client timeout 1629 ms). Trace:
W20260807 13:41:01.743326 23595 rpcz_store.cc:269] 0807 13:40:59.669742 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:59.675895 (+ 6153us) service_pool.cc:227] Handling call
0807 13:41:01.741921 (+2066026us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b54003b6354. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:41:01.742267 (+ 346us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1659432192}
I20260807 13:41:01.612586 25211 raft_consensus.cc:504] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.695271 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:01.696540 23705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 436) took 1131 ms. Trace:
I20260807 13:41:01.699606 23711 raft_consensus.cc:1226] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 4. Current term is 5. Ops: []
I20260807 13:41:01.699059 24739 consensus_queue.cc:1035] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:41:01.577183 24859 raft_consensus.cc:3037] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:01.765667 25257 raft_consensus.cc:482] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:01.718598 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "830e8cb8ce434e6391c09530c677a61d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:01.766718 25257 raft_consensus.cc:504] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.769327 25257 leader_election.cc:288] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:01.703208 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f8a5f186bf1473a988921e5efa3e574" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:01.769682 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:01.701905 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c1184114b02410098331e68d3b8d4cf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:01.599577 25033 leader_election.cc:288] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:01.593453 25181 raft_consensus.cc:482] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:01.757838 23705 rpcz_store.cc:276] 0807 13:41:00.564670 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:00.574944 (+ 10274us) service_pool.cc:227] Handling call
0807 13:41:01.496712 (+921768us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b5800004598. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914dbce 000000000034aea9 00007f4620f79a30 00007f462103f7b4 00007f462103f821 00007f46210032b0 00007f4620fee7f9 00007f4620fee2a2 00007f461a6d4684
0807 13:41:01.508784 (+ 12072us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:41:01.559083 (+ 50299us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:01.696245 (+137162us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":30839040}
I20260807 13:41:01.775576 25181 raft_consensus.cc:504] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.776847 25345 raft_consensus.cc:482] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:01.592746 25182 raft_consensus.cc:686] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:01.777812 25345 raft_consensus.cc:504] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.780176 25182 consensus_queue.cc:237] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.780920 25345 leader_election.cc:288] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:01.575685 25171 raft_consensus.cc:482] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:01.582444 25208 raft_consensus.cc:482] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
W20260807 13:41:01.595762 25251 consensus_meta.cc:287] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 1.264s user 0.016s sys 0.000s
I20260807 13:41:01.586382 25253 raft_consensus.cc:504] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.792268 25253 leader_election.cc:288] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:01.528915 25259 consensus_queue.cc:237] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.602176 25264 raft_consensus.cc:504] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.801961 25264 leader_election.cc:288] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:01.567546 25273 raft_consensus.cc:2726] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:41:01.591009 25290 leader_election.cc:288] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:01.551950 25286 raft_consensus.cc:504] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:41:01.612054 25298 consensus_meta.cc:287] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.517s user 0.011s sys 0.000s
I20260807 13:41:01.818828 24905 consensus_queue.cc:1046] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:41:01.819427 25298 raft_consensus.cc:504] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.820228 24905 raft_consensus.cc:3032] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:41:01.820797 24905 raft_consensus.cc:729] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:01.620191 25301 tablet_bootstrap.cc:654] T 7a180725c9e34d0095ab423614678d88 P 8a3af1d071e74f2eb0c821e2bd68fe37: Neither blocks nor log segments found. Creating new log.
I20260807 13:41:01.619521 25308 tablet_bootstrap.cc:654] T 7a180725c9e34d0095ab423614678d88 P d28e736aee9f4f01b013de670a762697: Neither blocks nor log segments found. Creating new log.
I20260807 13:41:01.823173 25181 leader_election.cc:288] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:41:01.603029 25319 log.cc:924] Time spent T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.136s user 0.001s sys 0.000s
I20260807 13:41:01.721717 23598 rpcz_store.cc:276] 0807 13:40:59.908289 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:01.368598 (+1460309us) service_pool.cc:227] Handling call
0807 13:41:01.369056 (+ 458us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:41:01.369739 (+ 683us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:41:01.369796 (+ 57us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:41:01.374640 (+ 4844us) log.cc:842] Serialized 26 byte log entry
0807 13:41:01.543080 (+168440us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:41:01.543134 (+ 54us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:01.545782 (+ 2648us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:41:01.671805 (+126023us) raft_consensus.cc:1671] finished
0807 13:41:01.671889 (+ 84us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:41:01.672286 (+ 397us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":818,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":5467,"thread_start_us":121775,"threads_started":1,"wal-append.queue_time_us":178788}
I20260807 13:41:01.828917 23598 raft_consensus.cc:1226] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:01.756250 23599 raft_consensus.cc:2454] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:01.760162 25211 leader_election.cc:288] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:01.595105 25070 leader_election.cc:288] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:01.763934 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:01.595695 25158 leader_election.cc:288] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:01.703436 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:01.771193 23594 raft_consensus.cc:2454] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:41:01.783679 25208 raft_consensus.cc:504] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.832841 23815 raft_consensus.cc:2362] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4. Re-sending same reply.
I20260807 13:41:01.833572 25209 raft_consensus.cc:3032] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:41:01.787075 25171 raft_consensus.cc:504] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:41:01.803557 25078 consensus_meta.cc:287] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.743s user 0.010s sys 0.004s
W20260807 13:41:01.803349 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 291829us
I20260807 13:41:01.745534 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:41:01.786564 25303 log.cc:924] Time spent T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.891s user 0.005s sys 0.003s
I20260807 13:41:01.585970 25269 raft_consensus.cc:504] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.806393 25033 raft_consensus.cc:482] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:01.807261 25333 raft_consensus.cc:482] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:01.818063 23591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 589) took 2141 ms. Trace:
I20260807 13:41:01.618793 25316 leader_election.cc:288] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:01.823194 24941 consensus_queue.cc:1046] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260807 13:41:01.852645 25078 raft_consensus.cc:504] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.872212 24941 raft_consensus.cc:3032] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:41:01.872630 24941 raft_consensus.cc:729] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:01.873157 23709 raft_consensus.cc:1226] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 3. Current term is 4. Ops: [1.1-3.2]
I20260807 13:41:01.874267 25078 leader_election.cc:288] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:01.830849 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:01.875908 23601 raft_consensus.cc:2379] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:41:01.875959 23813 raft_consensus.cc:2379] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 4: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:41:01.877346 25269 leader_election.cc:288] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:01.877413 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:01.840265 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:01.841282 23823 raft_consensus.cc:1261] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:41:01.841352 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:01.842981 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:01.843884 23817 raft_consensus.cc:1261] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:41:01.845553 23662 leader_election.cc:302] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
W20260807 13:41:01.887116 23662 leader_election.cc:341] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:41:01.887493 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:01.888000 23820 raft_consensus.cc:3037] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:01.845484 23595 raft_consensus.cc:2454] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:41:01.889297 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:01.834038 23588 raft_consensus.cc:1226] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:41:01.890113 23825 raft_consensus.cc:3037] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:01.848842 25246 ts_tablet_manager.cc:1905] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 13:41:01.891745 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:01.892704 23823 raft_consensus.cc:3037] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:01.893325 25333 raft_consensus.cc:504] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.849355 25208 leader_election.cc:288] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:01.834085 25209 raft_consensus.cc:729] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:01.895562 25209 consensus_queue.cc:260] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.896423 25333 leader_election.cc:288] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:01.896934 25209 raft_consensus.cc:3037] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:01.862866 25171 leader_election.cc:288] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:01.863531 25033 raft_consensus.cc:504] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.873955 24941 consensus_queue.cc:260] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.867112 25352 raft_consensus.cc:482] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:01.860399 23591 rpcz_store.cc:276] 0807 13:40:59.676926 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:00.585166 (+908240us) service_pool.cc:227] Handling call
0807 13:41:00.585548 (+ 382us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:41:00.656483 (+ 70935us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:41:00.779535 (+123052us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:41:00.888295 (+108760us) log.cc:842] Serialized 26 byte log entry
0807 13:41:01.257922 (+369627us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:41:01.373051 (+115129us) log.cc:842] Serialized 14 byte log entry
0807 13:41:01.388813 (+ 15762us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:01.417726 (+ 28913us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:41:01.790242 (+372516us) spinlock_profiling.cc:243] Waited 8.68 ms on lock 0x7b180012b140. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f46220248b1 00007f4622031661 00007f4619185638 00007f4619188b11 00007f4619188ac9 00007f4619188a59 00007f4619188a21 00007f4619187d1d 00007f46223e9204 00007f46223e9039 00007f4619167dc6
0807 13:41:01.815793 (+ 25551us) raft_consensus.cc:1671] finished
0807 13:41:01.817499 (+ 1706us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:41:01.817848 (+ 349us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":74387,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":9217,"raft.queue_time_us":8784,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":24740,"spinlock_wait_cycles":19953024,"thread_start_us":379394,"threads_started":2,"wal-append.queue_time_us":454048}
I20260807 13:41:01.854380 25257 consensus_queue.cc:1046] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:41:01.822432 24905 consensus_queue.cc:260] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.887378 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:01.903044 24941 raft_consensus.cc:3037] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:01.902895 25316 consensus_queue.cc:1035] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:41:01.907195 25286 leader_election.cc:288] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:01.903816 25158 raft_consensus.cc:2781] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:41:01.910753 25316 consensus_queue.cc:1046] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260807 13:41:01.911387 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 162299us
I20260807 13:41:01.912081 23817 raft_consensus.cc:2379] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 4: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:41:01.913271 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:01.914011 23817 raft_consensus.cc:2362] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3. Re-sending same reply.
I20260807 13:41:01.903878 25033 leader_election.cc:288] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:01.914477 25038 consensus_queue.cc:1035] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:41:01.916033 23600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 709) took 2000 ms. Trace:
I20260807 13:41:01.916412 23600 rpcz_store.cc:276] 0807 13:40:59.915557 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:01.388645 (+1473088us) service_pool.cc:227] Handling call
0807 13:41:01.426720 (+ 38075us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:41:01.465508 (+ 38788us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:01.915476 (+449968us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b5400378554. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:41:01.915817 (+ 341us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":77207808}
I20260807 13:41:01.919524 23590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 703) took 2074 ms. Trace:
I20260807 13:41:01.920001 23590 rpcz_store.cc:276] 0807 13:40:59.844835 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:01.367508 (+1522673us) service_pool.cc:227] Handling call
0807 13:41:01.918171 (+550663us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b5800001898. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f46210032b0 00007f4620fee7f9 00007f4620fee2a2 00007f461a6d4684
0807 13:41:01.918548 (+ 377us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:41:01.918861 (+ 313us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:41:01.918904 (+ 43us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:41:01.918995 (+ 91us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:41:01.919073 (+ 78us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:01.919161 (+ 88us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:41:01.919326 (+ 165us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":27719424}
W20260807 13:41:01.924595 25007 consensus_meta.cc:287] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.548s user 0.006s sys 0.010s
I20260807 13:41:01.925135 25007 raft_consensus.cc:504] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.908993 25352 raft_consensus.cc:504] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.927205 24905 raft_consensus.cc:3037] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:41:01.927670 23601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 580) took 2254 ms. Trace:
I20260807 13:41:01.928046 23601 rpcz_store.cc:276] 0807 13:40:59.673695 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:00.574492 (+900797us) service_pool.cc:227] Handling call
0807 13:41:01.307963 (+733471us) spinlock_profiling.cc:243] Waited 4.74 ms on lock 0x7b5800001898. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f4620fef1b0 00007f4620feea94 00007f461a6d6c04 00007f461a6d6b92
0807 13:41:01.927429 (+619466us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b54002535d4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:41:01.927600 (+ 171us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1224494720}
I20260807 13:41:01.928978 25352 leader_election.cc:288] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:01.931483 23814 raft_consensus.cc:1226] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:01.933418 23814 raft_consensus.cc:1261] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260807 13:41:01.935366 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 396861us
I20260807 13:41:01.935659 25033 raft_consensus.cc:482] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:01.936430 25033 raft_consensus.cc:504] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:41:01.937400 23554 leader_election.cc:334] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Timed out: RequestConsensusVote RPC to 127.21.82.67:46685 timed out after 2.048s (SENT)
I20260807 13:41:01.942831 25158 raft_consensus.cc:686] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:01.944047 25158 consensus_queue.cc:237] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.945541 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47680 (request call id 431) took 2015 ms. Trace:
I20260807 13:41:01.947798 25335 raft_consensus.cc:3032] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:41:01.948275 25335 raft_consensus.cc:729] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:01.946067 23702 rpcz_store.cc:276] 0807 13:40:59.930370 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:59.951981 (+ 21611us) service_pool.cc:227] Handling call
0807 13:40:59.953045 (+ 1064us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:41:00.244380 (+291335us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:41:00.244427 (+ 47us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:41:00.268405 (+ 23978us) log.cc:842] Serialized 52 byte log entry
0807 13:41:00.643918 (+375513us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:41:00.652242 (+ 8324us) log.cc:842] Serialized 14 byte log entry
0807 13:41:00.652593 (+ 351us) log.cc:842] Serialized 14 byte log entry
0807 13:41:00.652725 (+ 132us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:00.652787 (+ 62us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:41:01.740718 (+1087931us) spinlock_profiling.cc:243] Waited 7.97 ms on lock 0x7b18002e46e0. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f46220248b1 00007f4622031661 00007f4619185638 00007f4619188b11 00007f4619188ac9 00007f4619188a59 00007f4619188a21 00007f4619187d1d 00007f46223e9204 00007f46223e9039 00007f4619167dc6
0807 13:41:01.785464 (+ 44746us) spinlock_profiling.cc:243] Waited 6.71 ms on lock 0x7b44000232cc. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f4619097a95 00007f46190984b2 00007f461bd40511 00007f461bd3be1a 00007f461bd2fbee 00007f461bd2ef36 00007f461bd2eb58 00007f461bd38551 00007f461bd38509 00007f461bd38499
0807 13:41:01.945027 (+159563us) raft_consensus.cc:1671] finished
0807 13:41:01.945053 (+ 26us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:41:01.945280 (+ 227us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6453,"prepare.queue_time_us":26363,"prepare.run_cpu_time_us":855,"prepare.run_wall_time_us":2902,"raft.queue_time_us":25556,"raft.run_cpu_time_us":734,"raft.run_wall_time_us":48291,"spinlock_wait_cycles":35992064,"thread_start_us":600925,"threads_started":2,"wal-append.queue_time_us":499849}
I20260807 13:41:01.949227 23772 leader_election.cc:302] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:01.949390 25335 consensus_queue.cc:260] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.950189 25182 raft_consensus.cc:2781] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:41:01.950644 25182 raft_consensus.cc:482] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:41:01.951071 25182 raft_consensus.cc:3037] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:01.951542 25316 raft_consensus.cc:3032] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:41:01.952008 25316 raft_consensus.cc:729] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:01.953138 25316 consensus_queue.cc:260] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.910022 23813 raft_consensus.cc:1261] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:41:01.955205 25171 raft_consensus.cc:482] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:01.955566 25007 leader_election.cc:288] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:01.955855 25171 raft_consensus.cc:504] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.956303 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:01.958153 25171 leader_election.cc:288] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:01.959293 25078 consensus_queue.cc:1035] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:41:01.961027 23662 leader_election.cc:302] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:41:01.961076 25209 consensus_queue.cc:1035] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
I20260807 13:41:01.963757 23817 raft_consensus.cc:1261] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:41:01.964432 25208 raft_consensus.cc:2781] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:01.965348 25208 raft_consensus.cc:482] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:41:01.965729 25208 raft_consensus.cc:3037] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:01.974171 25335 raft_consensus.cc:3037] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:01.978976 23815 raft_consensus.cc:2379] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 4: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:41:01.980616 23820 raft_consensus.cc:2454] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:41:01.945592 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:41:01.982946 23662 leader_election.cc:341] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): Illegal state: Tablet not RUNNING: STOPPED
I20260807 13:41:01.958210 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
W20260807 13:41:01.984400 25092 consensus_meta.cc:287] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.667s user 0.008s sys 0.010s
I20260807 13:41:01.981978 23823 raft_consensus.cc:2454] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:41:01.998886 23814 raft_consensus.cc:2454] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:41:02.004175 25256 ts_tablet_manager.cc:1918] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 13:41:02.005137 25256 log.cc:1196] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812: Deleting WAL directory at /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109960278411-21833-0/minicluster-data/ts-0-root/wals/1f8a5f186bf1473a988921e5efa3e574
I20260807 13:41:02.002679 23825 raft_consensus.cc:2454] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:41:01.985749 25316 raft_consensus.cc:3037] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:02.007289 25269 consensus_queue.cc:1035] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:41:02.008538 24859 raft_consensus.cc:504] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.010692 25092 raft_consensus.cc:504] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.993410 25033 leader_election.cc:288] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:02.019054 23825 raft_consensus.cc:3032] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:41:02.019644 23825 raft_consensus.cc:729] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:02.008543 25256 ts_tablet_manager.cc:1939] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812: Deleting consensus metadata
I20260807 13:41:02.020339 25158 raft_consensus.cc:482] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:02.022308 25158 raft_consensus.cc:504] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:01.339123 23597 rpcz_store.cc:276] 0807 13:40:59.675016 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:00.550552 (+875536us) service_pool.cc:227] Handling call
0807 13:41:00.624452 (+ 73900us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:41:00.624937 (+ 485us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:41:00.624977 (+ 40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:41:00.642755 (+ 17778us) log.cc:842] Serialized 26 byte log entry
0807 13:41:00.891390 (+248635us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:41:01.260414 (+369024us) log.cc:842] Serialized 14 byte log entry
0807 13:41:01.260744 (+ 330us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:01.260840 (+ 96us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:41:01.260890 (+ 50us) raft_consensus.cc:1671] finished
0807 13:41:01.260907 (+ 17us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:41:01.261067 (+ 160us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":407532,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":6345,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":13965,"thread_start_us":571114,"threads_started":2,"wal-append.queue_time_us":453595}
I20260807 13:41:02.028100 25158 leader_election.cc:288] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:02.029994 24859 leader_election.cc:288] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:02.032507 23812 raft_consensus.cc:1226] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:02.032620 23825 consensus_queue.cc:260] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.010486 25188 raft_consensus.cc:504] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.035305 25208 raft_consensus.cc:504] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
I20260807 13:41:02.036469 23821 raft_consensus.cc:1226] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:02.037875 25208 leader_election.cc:288] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Requested vote from peers d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685), 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187)
I20260807 13:41:02.034608 23825 raft_consensus.cc:3037] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:41:02.046092 23772 leader_election.cc:302] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:02.048643 23772 leader_election.cc:302] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:02.049995 25259 raft_consensus.cc:2726] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:02.049698 25271 consensus_queue.cc:260] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.050774 25259 raft_consensus.cc:2726] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:02.051332 25271 raft_consensus.cc:3037] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:02.056524 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f8a5f186bf1473a988921e5efa3e574" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:02.056885 23711 raft_consensus.cc:1261] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:41:02.060130 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "830e8cb8ce434e6391c09530c677a61d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:02.061060 23813 raft_consensus.cc:1261] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:41:02.061125 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:02.061060 25298 leader_election.cc:288] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:02.063196 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c1184114b02410098331e68d3b8d4cf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:02.049685 23825 raft_consensus.cc:1261] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:41:02.063732 23702 raft_consensus.cc:1261] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:41:02.064834 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:02.066936 23711 raft_consensus.cc:1261] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260807 13:41:02.068424 25256 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43804 (request call id 59) took 2479 ms. Trace:
I20260807 13:41:02.068305 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:02.068893 25256 rpcz_store.cc:276] 0807 13:40:59.634975 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:59.685091 (+ 50116us) service_pool.cc:227] Handling call
0807 13:40:59.771082 (+ 85991us) ts_tablet_manager.cc:1145] Deleting tablet 1f8a5f186bf1473a988921e5efa3e574
0807 13:40:59.771206 (+ 124us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 13:41:01.466132 (+1694926us) tablet_metadata.cc:641] Metadata flushed
0807 13:41:02.003419 (+537287us) tablet_metadata.cc:641] Metadata flushed
0807 13:41:02.068295 (+ 64876us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":616230,"tablet-delete.queue_time_us":78230,"thread_start_us":22893,"threads_started":1}
I20260807 13:41:02.070302 25188 leader_election.cc:288] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:02.071602 23704 raft_consensus.cc:2396] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 13:41:02.034610 25092 leader_election.cc:288] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:02.076040 25182 raft_consensus.cc:504] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
@ 0x7f461881fadb google::LogMessageFatal::~LogMessageFatal() at ??:0
I20260807 13:41:02.081547 25038 raft_consensus.cc:482] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:02.082243 25038 raft_consensus.cc:504] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.084379 25007 raft_consensus.cc:482] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:02.084546 23662 leader_election.cc:302] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:02.084722 25257 raft_consensus.cc:482] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:02.084892 24941 consensus_queue.cc:1035] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:41:02.085096 25007 raft_consensus.cc:504] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.085347 25257 raft_consensus.cc:504] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.086321 23662 leader_election.cc:302] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:02.087518 25158 raft_consensus.cc:2781] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:02.086520 24941 raft_consensus.cc:2781] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:41:02.087697 25257 leader_election.cc:288] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:02.087986 25158 raft_consensus.cc:482] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:02.088028 24941 raft_consensus.cc:482] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:41:02.088634 25158 raft_consensus.cc:3037] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:02.088766 24941 raft_consensus.cc:3037] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:41:02.088208 25007 leader_election.cc:288] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:02.087982 23662 leader_election.cc:302] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:02.093803 23662 leader_election.cc:302] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:02.101302 24941 raft_consensus.cc:504] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.102285 25033 raft_consensus.cc:2781] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:41:02.102777 25033 raft_consensus.cc:482] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:41:02.103176 25033 raft_consensus.cc:3037] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:02.107860 25332 raft_consensus.cc:2781] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:41:02.108381 25332 raft_consensus.cc:482] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:41:02.108678 24941 leader_election.cc:288] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:02.108768 25332 raft_consensus.cc:3037] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:02.112499 25352 raft_consensus.cc:482] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:41:02.050267 23772 leader_election.cc:302] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:02.125625 23585 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43804 (request call id 60) took 1710 ms. Trace:
I20260807 13:41:02.126046 25368 tablet_bootstrap.cc:492] T 7a180725c9e34d0095ab423614678d88 P 08757cfbeffb41bbab14c2ef00e9d812: Bootstrap starting.
I20260807 13:41:02.126137 23585 rpcz_store.cc:276] 0807 13:41:00.415248 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:00.420982 (+ 5734us) service_pool.cc:227] Handling call
0807 13:41:01.022183 (+601201us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:41:01.022327 (+ 144us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:41:01.437413 (+415086us) tablet_metadata.cc:641] Metadata flushed
0807 13:41:01.922023 (+484610us) tablet_replica.cc:205] Creating consensus instance
0807 13:41:02.125344 (+203321us) inbound_call.cc:173] Queueing success response
0807 13:41:02.125350 (+ 6us) ts_tablet_manager.cc:1373] Bootstrapping tablet
Metrics: {"spinlock_wait_cycles":9600,"tablet-open.queue_time_us":193716,"thread_start_us":193238,"threads_started":1}
I20260807 13:41:02.078685 25182 leader_election.cc:288] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:02.084504 25038 leader_election.cc:288] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:02.148398 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:02.244892 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:02.340467 25033 raft_consensus.cc:504] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.165133 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:02.203316 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:02.298399 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:02.246438 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:02.247332 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "830e8cb8ce434e6391c09530c677a61d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:41:02.353935 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 210083us
I20260807 13:41:02.246958 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:02.349244 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:02.235476 25038 raft_consensus.cc:482] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:41:02.245821 25361 raft_consensus.cc:482] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:02.290187 25000 raft_consensus.cc:482] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:02.145567 25269 raft_consensus.cc:482] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:02.185756 25280 raft_consensus.cc:482] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:02.165225 25092 raft_consensus.cc:2726] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 13:41:02.358417 23554 leader_election.cc:334] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Timed out: RequestConsensusVote RPC to 127.21.82.67:46685 timed out after 1.626s (SENT)
I20260807 13:41:02.382366 23710 raft_consensus.cc:1261] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:41:02.282301 24739 raft_consensus.cc:482] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:02.357682 23812 raft_consensus.cc:1261] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:41:02.165107 23597 raft_consensus.cc:3037] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:02.382853 23554 leader_election.cc:302] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:41:02.367440 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
W20260807 13:41:02.370666 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 320455us
I20260807 13:41:02.370851 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:02.387563 23825 raft_consensus.cc:2379] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 4: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:41:02.372938 23711 raft_consensus.cc:1261] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:41:02.146886 25352 raft_consensus.cc:504] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.372601 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:02.373572 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:02.384570 23600 raft_consensus.cc:2379] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:41:02.393533 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:02.396207 23825 raft_consensus.cc:1261] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:41:02.385859 23588 raft_consensus.cc:3037] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:02.399111 23814 raft_consensus.cc:2379] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 5: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:41:02.396742 23591 raft_consensus.cc:2379] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 5: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:41:02.400331 23662 leader_election.cc:302] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:02.405958 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:02.407441 25062 raft_consensus.cc:2726] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:02.397933 25246 ts_tablet_manager.cc:1918] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 13:41:02.411005 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac6e18ecd14ba2a7d3e846a9fc81bf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:02.395618 23705 raft_consensus.cc:2454] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:41:02.415274 23600 raft_consensus.cc:1226] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4. Ops: [1.1-3.2]
I20260807 13:41:02.394400 25280 raft_consensus.cc:504] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.392819 25038 raft_consensus.cc:504] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.419126 23825 raft_consensus.cc:1226] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260807 13:41:02.421252 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 81220.5us
I20260807 13:41:02.412611 25246 log.cc:1196] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697: Deleting WAL directory at /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109960278411-21833-0/minicluster-data/ts-2-root/wals/1f8a5f186bf1473a988921e5efa3e574
I20260807 13:41:02.424276 23599 raft_consensus.cc:2454] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:41:02.398713 24739 raft_consensus.cc:504] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.400051 25269 raft_consensus.cc:504] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.397845 25361 raft_consensus.cc:504] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.401161 25000 raft_consensus.cc:504] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.433673 23825 raft_consensus.cc:1226] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:41:02.436679 25308 tablet_bootstrap.cc:492] T 7a180725c9e34d0095ab423614678d88 P d28e736aee9f4f01b013de670a762697: No bootstrap required, opened a new log
I20260807 13:41:02.424194 25354 raft_consensus.cc:3037] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:41:02.427618 23554 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.82.67:46685 timed out after 1.659s (SENT) [suppressed 72 similar messages]
I20260807 13:41:02.444921 23601 raft_consensus.cc:3037] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:02.430553 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:02.446851 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:02.454694 23825 raft_consensus.cc:1226] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:02.433270 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:02.456321 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:02.439281 25033 leader_election.cc:288] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:02.457500 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:02.457892 23598 raft_consensus.cc:3037] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:02.458132 23599 raft_consensus.cc:2454] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:41:02.450063 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:02.468003 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:02.461804 25246 ts_tablet_manager.cc:1939] T 1f8a5f186bf1473a988921e5efa3e574 P d28e736aee9f4f01b013de670a762697: Deleting consensus metadata
I20260807 13:41:02.474807 23432 catalog_manager.cc:4841] TS 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187): tablet 1f8a5f186bf1473a988921e5efa3e574 (table test-workload [id=14f16c1129ee464da3f6afb00584355d]) successfully deleted
I20260807 13:41:02.476323 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:02.494922 23812 raft_consensus.cc:1226] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:02.499541 23813 raft_consensus.cc:1226] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:02.501307 25000 leader_election.cc:288] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:02.502283 25269 leader_election.cc:288] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:02.503082 23710 raft_consensus.cc:1261] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:41:02.485590 25308 ts_tablet_manager.cc:1397] T 7a180725c9e34d0095ab423614678d88 P d28e736aee9f4f01b013de670a762697: Time spent bootstrapping tablet: real 1.524s user 0.047s sys 0.074s
I20260807 13:41:02.508553 23599 raft_consensus.cc:3037] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:02.512599 23662 leader_election.cc:302] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:02.510196 23601 raft_consensus.cc:2454] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:02.460071 25092 consensus_queue.cc:1046] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260807 13:41:02.514814 25332 raft_consensus.cc:504] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.515213 25262 consensus_queue.cc:1046] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:41:02.516072 25262 consensus_queue.cc:1225] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer 08757cfbeffb41bbab14c2ef00e9d812 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260807 13:41:02.516618 25262 raft_consensus.cc:3032] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:41:02.516960 25262 raft_consensus.cc:729] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:02.517890 25332 leader_election.cc:288] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:02.518165 25033 raft_consensus.cc:2726] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:41:02.522243 23813 raft_consensus.cc:1226] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:02.488448 25007 raft_consensus.cc:482] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:02.509299 23814 raft_consensus.cc:2354] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
I20260807 13:41:02.526268 23825 raft_consensus.cc:1226] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3. Ops: []
W20260807 13:41:02.527804 23660 leader_election.cc:334] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Timed out: RequestConsensusVote RPC to 127.21.82.67:46685 timed out after 1.582s (SENT)
I20260807 13:41:02.528160 24739 leader_election.cc:288] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:02.528321 23660 leader_election.cc:302] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:02.529362 25007 raft_consensus.cc:504] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.531276 25007 leader_election.cc:288] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:02.532823 25301 tablet_bootstrap.cc:492] T 7a180725c9e34d0095ab423614678d88 P 8a3af1d071e74f2eb0c821e2bd68fe37: No bootstrap required, opened a new log
I20260807 13:41:02.533480 25301 ts_tablet_manager.cc:1397] T 7a180725c9e34d0095ab423614678d88 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent bootstrapping tablet: real 1.640s user 0.045s sys 0.063s
I20260807 13:41:02.535115 23595 raft_consensus.cc:1261] T daaea1dffb5443f4858c40ca25e7830e P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:41:02.518002 25262 consensus_queue.cc:260] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.539881 25158 raft_consensus.cc:504] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.540050 25062 consensus_queue.cc:1035] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260807 13:41:02.540642 25316 consensus_meta.cc:287] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.526s user 0.007s sys 0.005s
I20260807 13:41:02.540444 25284 consensus_queue.cc:1035] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:41:02.541790 25269 consensus_queue.cc:1035] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:41:02.520143 25368 tablet_bootstrap.cc:654] T 7a180725c9e34d0095ab423614678d88 P 08757cfbeffb41bbab14c2ef00e9d812: Neither blocks nor log segments found. Creating new log.
I20260807 13:41:02.509049 25352 leader_election.cc:288] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:02.547140 25361 leader_election.cc:288] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:02.547751 24905 raft_consensus.cc:2726] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:02.548697 25280 leader_election.cc:288] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:02.548871 25209 raft_consensus.cc:482] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:02.550043 25038 leader_election.cc:288] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:02.560652 23599 raft_consensus.cc:2454] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 5.
W20260807 13:41:02.570910 25376 log.cc:924] Time spent T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.124s user 0.000s sys 0.001s
I20260807 13:41:02.559717 24739 consensus_queue.cc:1035] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260807 13:41:02.575335 25246 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45346 (request call id 59) took 3115 ms. Trace:
I20260807 13:41:02.592582 23598 raft_consensus.cc:2454] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:02.581473 23813 raft_consensus.cc:1261] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:41:02.569424 25209 raft_consensus.cc:504] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.608803 23825 raft_consensus.cc:1226] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:02.614228 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:02.615337 23812 raft_consensus.cc:2354] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
I20260807 13:41:02.595664 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:02.588406 25262 raft_consensus.cc:3037] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:02.647315 25000 raft_consensus.cc:482] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:02.680882 25000 raft_consensus.cc:504] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.683395 25000 leader_election.cc:288] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:02.693059 23597 raft_consensus.cc:2454] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:02.698439 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9552d42b445450691daef21fba4059a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:02.698858 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:02.705211 25038 raft_consensus.cc:482] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:02.705745 23814 raft_consensus.cc:2379] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 4: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:41:02.705874 25038 raft_consensus.cc:504] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.708989 25038 leader_election.cc:288] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:02.710440 25188 raft_consensus.cc:3032] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:41:02.710886 25188 raft_consensus.cc:729] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:02.711860 25188 consensus_queue.cc:260] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.713078 25188 raft_consensus.cc:3037] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:41:02.591593 25246 rpcz_store.cc:276] 0807 13:40:59.453397 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:59.455898 (+ 2501us) service_pool.cc:227] Handling call
0807 13:40:59.776385 (+320487us) ts_tablet_manager.cc:1145] Deleting tablet 1f8a5f186bf1473a988921e5efa3e574
0807 13:41:00.345588 (+569203us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 13:41:01.775711 (+1430123us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b2400226ef8. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f4618fddcf4 00007f4618fdbdfb 00007f461906a559 00007f461906a1e5 00007f4619069740 00007f461bd17f05 00007f461bd31969 00007f461bd360a3 00007f461fa7d3c5 00007f462103dcfa
0807 13:41:02.039123 (+263412us) tablet_metadata.cc:641] Metadata flushed
0807 13:41:02.384993 (+345870us) tablet_metadata.cc:641] Metadata flushed
0807 13:41:02.538325 (+153332us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b5800255098. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914de82 00007f46220668b9 00007f4620f795d8 00007f462103de42 00007f462106de10 00007f4621054e0d 00007f4621054db9 00007f4621054d49 00007f4621054d11
0807 13:41:02.565526 (+ 27201us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":28830,"spinlock_wait_cycles":41439232,"tablet-delete.queue_time_us":283057,"thread_start_us":173483,"threads_started":1}
I20260807 13:41:02.718835 23429 catalog_manager.cc:4841] TS d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): tablet 1f8a5f186bf1473a988921e5efa3e574 (table test-workload [id=14f16c1129ee464da3f6afb00584355d]) successfully deleted
I20260807 13:41:02.719321 25209 leader_election.cc:288] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:02.720883 25158 leader_election.cc:288] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:41:02.722400 25382 log.cc:924] Time spent T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.124s user 0.000s sys 0.000s
I20260807 13:41:02.726334 25354 raft_consensus.cc:2726] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:41:02.726421 25248 ts_tablet_manager.cc:1918] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 13:41:02.731482 25248 log.cc:1196] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37: Deleting WAL directory at /tmp/dist-test-taskfOZNRn/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109960278411-21833-0/minicluster-data/ts-1-root/wals/1f8a5f186bf1473a988921e5efa3e574
I20260807 13:41:02.731696 23814 raft_consensus.cc:1226] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4. Ops: []
W20260807 13:41:02.736418 25383 log.cc:924] Time spent T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.059s user 0.000s sys 0.000s
I20260807 13:41:02.737979 23812 raft_consensus.cc:3037] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 3
I20260807 13:41:02.739753 25301 raft_consensus.cc:348] T 7a180725c9e34d0095ab423614678d88 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.740649 25301 raft_consensus.cc:374] T 7a180725c9e34d0095ab423614678d88 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:41:02.740955 25301 raft_consensus.cc:729] T 7a180725c9e34d0095ab423614678d88 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Initialized, Role: FOLLOWER
I20260807 13:41:02.741768 25301 consensus_queue.cc:260] T 7a180725c9e34d0095ab423614678d88 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.743114 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:02.744663 25301 ts_tablet_manager.cc:1428] T 7a180725c9e34d0095ab423614678d88 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent starting tablet: real 0.211s user 0.008s sys 0.000s
I20260807 13:41:02.745385 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:02.746384 23814 raft_consensus.cc:2396] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 13:41:02.747289 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:02.748555 25308 raft_consensus.cc:348] T 7a180725c9e34d0095ab423614678d88 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.748844 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:02.748859 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4062e0223a4cc0b2e448e35445671d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:02.749572 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:02.751339 23820 raft_consensus.cc:1226] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4. Ops: [1.1-3.2]
W20260807 13:41:02.757375 23535 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:41:02.764305 25092 raft_consensus.cc:482] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:02.770545 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:02.772192 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:02.772676 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
W20260807 13:41:02.773481 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 230200us
I20260807 13:41:02.791406 23820 raft_consensus.cc:1226] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 4. Current term is 5. Ops: []
I20260807 13:41:02.766306 23588 raft_consensus.cc:2454] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 5.
I20260807 13:41:02.792321 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:02.773167 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:02.792111 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "830e8cb8ce434e6391c09530c677a61d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:02.782851 25308 raft_consensus.cc:374] T 7a180725c9e34d0095ab423614678d88 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:41:02.796756 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:02.808403 23823 raft_consensus.cc:2454] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:02.792109 25269 raft_consensus.cc:482] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:41:02.803336 25284 consensus_queue.cc:1035] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:41:02.807435 25248 ts_tablet_manager.cc:1939] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37: Deleting consensus metadata
I20260807 13:41:02.813583 23555 leader_election.cc:302] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:02.816068 25269 raft_consensus.cc:504] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.819036 25062 raft_consensus.cc:2781] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:41:02.819500 25062 raft_consensus.cc:482] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:02.819839 25062 raft_consensus.cc:3037] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:02.821645 23812 raft_consensus.cc:2454] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:41:02.808141 25308 raft_consensus.cc:729] T 7a180725c9e34d0095ab423614678d88 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Initialized, Role: FOLLOWER
I20260807 13:41:02.873806 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:02.875783 23823 raft_consensus.cc:2379] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 4: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:41:02.793049 25092 raft_consensus.cc:504] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:41:02.929554 23554 leader_election.cc:334] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Timed out: RequestConsensusVote RPC to 127.21.82.67:46685 timed out after 1.578s (SENT)
I20260807 13:41:02.844468 25361 consensus_queue.cc:1035] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.085s
I20260807 13:41:02.927397 25269 leader_election.cc:288] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:02.935468 25354 raft_consensus.cc:482] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:41:02.939726 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:02.933703 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac6e18ecd14ba2a7d3e846a9fc81bf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
W20260807 13:41:02.947649 23554 leader_election.cc:334] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Timed out: RequestConsensusVote RPC to 127.21.82.67:46685 timed out after 2.003s (SENT)
I20260807 13:41:02.953940 23554 leader_election.cc:302] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:41:02.939203 25354 raft_consensus.cc:504] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.962092 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:02.962519 23825 raft_consensus.cc:2454] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:41:02.966710 25248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47664 (request call id 59) took 3501 ms. Trace:
I20260807 13:41:02.967206 25248 rpcz_store.cc:276] 0807 13:40:59.465563 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:40:59.469216 (+ 3653us) service_pool.cc:227] Handling call
0807 13:40:59.775950 (+306734us) ts_tablet_manager.cc:1145] Deleting tablet 1f8a5f186bf1473a988921e5efa3e574
0807 13:40:59.778189 (+ 2239us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 13:41:01.918584 (+2140395us) tablet_metadata.cc:641] Metadata flushed
0807 13:41:02.726010 (+807426us) tablet_metadata.cc:641] Metadata flushed
0807 13:41:02.966537 (+240527us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":528570,"tablet-delete.queue_time_us":293276,"thread_start_us":208427,"threads_started":1}
I20260807 13:41:02.975661 25000 raft_consensus.cc:482] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
W20260807 13:41:02.976677 25389 log.cc:924] Time spent T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.180s user 0.002s sys 0.000s
I20260807 13:41:02.976527 25000 raft_consensus.cc:504] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.934168 25308 consensus_queue.cc:260] T 7a180725c9e34d0095ab423614678d88 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:02.981078 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:02.981711 25308 ts_tablet_manager.cc:1428] T 7a180725c9e34d0095ab423614678d88 P d28e736aee9f4f01b013de670a762697: Time spent starting tablet: real 0.469s user 0.018s sys 0.005s
I20260807 13:41:02.984627 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:02.985093 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:02.993130 23430 catalog_manager.cc:4841] TS 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833): tablet 1f8a5f186bf1473a988921e5efa3e574 (table test-workload [id=14f16c1129ee464da3f6afb00584355d]) successfully deleted
I20260807 13:41:02.994275 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4062e0223a4cc0b2e448e35445671d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:02.995544 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
@ 0x7f46227e180e kudu::TestWorkload::Setup() at ??:0
I20260807 13:41:02.996820 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:02.997709 23817 raft_consensus.cc:2354] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
@ 0x345a78 kudu::master::LeaderRebalancerTest::CreateWorkloadTable() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:109
@ 0x3424af kudu::master::LeaderRebalancerTest_AddTserver_Test::TestBody() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:411
I20260807 13:41:02.985380 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:02.999131 25361 raft_consensus.cc:2726] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:03.000092 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:03.001441 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:02.986097 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:03.002528 25354 leader_election.cc:288] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:03.002918 23821 raft_consensus.cc:2454] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:41:03.003795 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:02.986822 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:02.987025 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:02.988313 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:03.004921 23823 raft_consensus.cc:2379] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 4: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:41:02.989464 23812 raft_consensus.cc:1261] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:41:03.006400 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:03.006877 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:03.007504 23812 raft_consensus.cc:2454] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:41:03.004786 23818 raft_consensus.cc:2454] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:03.008317 23814 raft_consensus.cc:2454] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:41:03.008597 23815 raft_consensus.cc:1261] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:41:03.009431 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:03.010138 23823 raft_consensus.cc:2354] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
I20260807 13:41:03.010334 25368 tablet_bootstrap.cc:492] T 7a180725c9e34d0095ab423614678d88 P 08757cfbeffb41bbab14c2ef00e9d812: No bootstrap required, opened a new log
I20260807 13:41:03.010897 25368 ts_tablet_manager.cc:1397] T 7a180725c9e34d0095ab423614678d88 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent bootstrapping tablet: real 0.885s user 0.041s sys 0.060s
W20260807 13:41:02.991894 23754 tablet.cc:2369] T 7a180725c9e34d0095ab423614678d88 P 8a3af1d071e74f2eb0c821e2bd68fe37: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 13:41:02.991241 23448 catalog_manager.cc:5495] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 3 to 4, leader changed from d28e736aee9f4f01b013de670a762697 (127.21.82.67) to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 4 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:41:03.015774 23448 catalog_manager.cc:5495] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 2 to 3, leader changed from 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65) to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 3 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:41:02.992801 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:41:03.021122 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 96322.3us
I20260807 13:41:03.022197 23825 raft_consensus.cc:2454] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:03.019908 23448 catalog_manager.cc:5495] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:41:03.028187 23662 leader_election.cc:302] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:03.030048 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:03.030694 23825 raft_consensus.cc:2454] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:03.030613 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:03.031448 23707 raft_consensus.cc:2454] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:41:03.032881 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:03.033052 23662 leader_election.cc:302] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:03.033160 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:03.033980 24905 raft_consensus.cc:2781] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:41:03.034130 25354 raft_consensus.cc:2781] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:41:03.034539 25354 raft_consensus.cc:482] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:03.034945 25354 raft_consensus.cc:3037] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:02.998584 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9552d42b445450691daef21fba4059a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:03.034354 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4062e0223a4cc0b2e448e35445671d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:03.038909 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:03.039491 23703 raft_consensus.cc:2454] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:41:03.040724 23448 catalog_manager.cc:5495] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:41:03.040838 23817 raft_consensus.cc:2362] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3. Re-sending same reply.
I20260807 13:41:03.042407 23448 catalog_manager.cc:5495] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:41:03.043088 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:03.045668 23448 catalog_manager.cc:5495] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 2 to 3, leader changed from 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65) to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 3 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:41:03.047250 23662 leader_election.cc:302] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:03.028875 25092 leader_election.cc:288] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:03.051728 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:03.034387 24905 raft_consensus.cc:482] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:03.050236 23448 catalog_manager.cc:5495] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 2 to 4, leader changed from d28e736aee9f4f01b013de670a762697 (127.21.82.67) to 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66). New cstate: current_term: 4 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:41:03.044652 25062 raft_consensus.cc:504] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.058055 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:03.059247 23662 leader_election.cc:302] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:03.059996 25062 leader_election.cc:288] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:03.060254 25316 raft_consensus.cc:2781] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:41:03.047982 25000 leader_election.cc:288] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:03.064627 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac6e18ecd14ba2a7d3e846a9fc81bf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:03.056308 23448 catalog_manager.cc:5495] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } }
I20260807 13:41:03.066869 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:03.054026 24905 raft_consensus.cc:3037] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:03.051880 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:03.072551 23448 catalog_manager.cc:5495] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 2 to 3, leader changed from 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65) to d28e736aee9f4f01b013de670a762697 (127.21.82.67). New cstate: current_term: 3 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } }
I20260807 13:41:03.074872 23448 catalog_manager.cc:5495] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 1 to 3, leader changed from 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66) to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 3 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } }
I20260807 13:41:03.077445 25368 raft_consensus.cc:348] T 7a180725c9e34d0095ab423614678d88 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.077243 23448 catalog_manager.cc:5495] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: HEALTHY } } }
I20260807 13:41:03.078207 25368 raft_consensus.cc:374] T 7a180725c9e34d0095ab423614678d88 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:41:03.078738 25361 raft_consensus.cc:482] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:41:03.079301 25361 raft_consensus.cc:504] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.081486 25361 leader_election.cc:288] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:03.082491 25361 raft_consensus.cc:482] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:41:03.082983 25361 raft_consensus.cc:504] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.084916 25361 leader_election.cc:288] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:03.086875 25000 raft_consensus.cc:482] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:03.087069 23594 raft_consensus.cc:1226] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 13:41:03.087383 25000 raft_consensus.cc:504] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.089579 25000 leader_election.cc:288] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:03.090109 25000 consensus_queue.cc:1035] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:41:03.061383 25209 raft_consensus.cc:2781] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:41:03.098014 23814 raft_consensus.cc:2379] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 4: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:41:03.102881 25209 raft_consensus.cc:686] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:03.104136 25209 consensus_queue.cc:237] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.078523 25368 raft_consensus.cc:729] T 7a180725c9e34d0095ab423614678d88 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Initialized, Role: FOLLOWER
I20260807 13:41:03.124457 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:03.125357 23597 raft_consensus.cc:3037] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
W20260807 13:41:03.136200 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 125367us
I20260807 13:41:03.148505 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:03.148766 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:03.149417 23598 raft_consensus.cc:2379] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 4: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:41:03.158517 23591 raft_consensus.cc:1226] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 3. Current term is 4. Ops: [1.1-3.2]
W20260807 13:41:03.161391 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 95336.2us
I20260807 13:41:03.102222 25354 raft_consensus.cc:504] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.162820 25316 raft_consensus.cc:686] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:03.163322 25070 raft_consensus.cc:482] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:03.163825 25070 raft_consensus.cc:504] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.163980 25316 consensus_queue.cc:237] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
I20260807 13:41:03.165848 25070 leader_election.cc:288] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:03.166684 25284 raft_consensus.cc:482] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:41:03.167203 25284 raft_consensus.cc:504] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.168496 25354 leader_election.cc:288] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:03.169342 23711 raft_consensus.cc:2379] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 4: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:41:03.169728 25284 leader_election.cc:288] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:03.170266 23662 leader_election.cc:302] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:03.172914 23662 leader_election.cc:302] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:03.173292 25354 raft_consensus.cc:2781] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:41:03.176755 25354 raft_consensus.cc:686] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:03.176815 25408 raft_consensus.cc:2781] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:41:03.177948 25408 raft_consensus.cc:686] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:03.177816 25354 consensus_queue.cc:237] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.179149 25408 consensus_queue.cc:237] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.195226 23597 raft_consensus.cc:2454] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 4.
I20260807 13:41:03.196554 23662 leader_election.cc:302] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:03.197621 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:03.200117 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:03.200894 23597 raft_consensus.cc:3037] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:03.204298 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:03.206071 23591 raft_consensus.cc:3037] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:03.207686 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:03.209203 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:03.209932 23600 raft_consensus.cc:2379] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 4: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:41:03.211251 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:03.223850 23597 raft_consensus.cc:2454] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 4.
I20260807 13:41:03.211809 23601 raft_consensus.cc:3037] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:03.205507 25158 raft_consensus.cc:2781] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:41:03.205664 23588 raft_consensus.cc:1226] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:41:03.237501 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:03.245797 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:03.249997 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:03.248059 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:03.252170 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:03.252774 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:03.253561 23709 raft_consensus.cc:2454] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:41:03.256966 23594 raft_consensus.cc:1226] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:03.259734 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:03.189532 25368 consensus_queue.cc:260] T 7a180725c9e34d0095ab423614678d88 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.267647 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:03.269268 23597 raft_consensus.cc:1226] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 2. Current term is 3. Ops: []
I20260807 13:41:03.274178 23597 raft_consensus.cc:1226] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 4. Current term is 5. Ops: []
I20260807 13:41:03.274469 23599 raft_consensus.cc:1226] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260807 13:41:03.277040 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
W20260807 13:41:03.277320 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 67040.9us
I20260807 13:41:03.278051 23601 raft_consensus.cc:2454] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 4.
I20260807 13:41:03.279731 23594 raft_consensus.cc:1226] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:03.282389 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:03.283180 23601 raft_consensus.cc:3037] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:03.268330 25280 raft_consensus.cc:482] T 7a180725c9e34d0095ab423614678d88 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:41:03.285221 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 80173.7us
I20260807 13:41:03.273906 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:03.303218 23595 raft_consensus.cc:3037] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:41:03.303505 23769 leader_election.cc:302] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:03.308861 23554 leader_election.cc:302] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:41:03.316622 23600 raft_consensus.cc:1226] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:03.318311 25158 raft_consensus.cc:686] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:03.319599 25158 consensus_queue.cc:237] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.325891 23600 raft_consensus.cc:1261] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:41:03.310209 25000 raft_consensus.cc:482] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:03.310984 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:03.300134 25269 consensus_queue.cc:1035] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260807 13:41:03.290346 25280 raft_consensus.cc:504] T 7a180725c9e34d0095ab423614678d88 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.347435 23594 raft_consensus.cc:1261] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:41:03.355566 23600 raft_consensus.cc:1226] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:41:03.355739 23554 leader_election.cc:302] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:41:03.351608 23601 raft_consensus.cc:2454] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 4.
I20260807 13:41:03.322335 25092 raft_consensus.cc:2726] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:41:03.305835 25284 consensus_queue.cc:1035] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
W20260807 13:41:03.359263 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 100968us
I20260807 13:41:03.314031 25062 consensus_queue.cc:1046] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260807 13:41:03.309993 25352 consensus_queue.cc:1035] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260807 13:41:03.316274 25396 consensus_queue.cc:1035] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
W20260807 13:41:03.390955 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 75801.1us
I20260807 13:41:03.389108 23595 raft_consensus.cc:2454] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:41:03.313194 25409 consensus_queue.cc:1046] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.056s
W20260807 13:41:03.395889 25406 log.cc:924] Time spent T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.127s user 0.000s sys 0.001s
W20260807 13:41:03.399212 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 57613.4us
I20260807 13:41:03.398128 25420 raft_consensus.cc:482] T 7a180725c9e34d0095ab423614678d88 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:03.410192 25420 raft_consensus.cc:504] T 7a180725c9e34d0095ab423614678d88 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.342274 24739 consensus_queue.cc:1035] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260807 13:41:03.416322 23595 raft_consensus.cc:1261] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:41:03.347043 25000 raft_consensus.cc:504] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:41:03.459036 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 61796.1us
I20260807 13:41:03.393998 25388 raft_consensus.cc:2726] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:41:03.406769 25038 raft_consensus.cc:2726] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:03.484467 23554 leader_election.cc:302] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:03.492345 25420 leader_election.cc:288] T 7a180725c9e34d0095ab423614678d88 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:03.457933 25361 raft_consensus.cc:482] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:41:03.503834 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:03.509869 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4062e0223a4cc0b2e448e35445671d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:03.510478 23598 raft_consensus.cc:3037] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:41:03.512281 23591 raft_consensus.cc:2454] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 4.
I20260807 13:41:03.397847 25415 consensus_queue.cc:1046] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.099s
I20260807 13:41:03.488765 25092 raft_consensus.cc:482] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:41:03.521466 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 51415.1us
I20260807 13:41:03.493211 25284 raft_consensus.cc:2781] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:41:03.431735 24905 raft_consensus.cc:504] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.526857 23591 raft_consensus.cc:1226] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:03.461270 25419 consensus_queue.cc:1046] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260807 13:41:03.496557 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:03.529001 23554 leader_election.cc:302] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:41:03.531322 23601 raft_consensus.cc:1261] T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:41:03.485870 25409 consensus_queue.cc:1046] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.036s
I20260807 13:41:03.535414 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:03.412433 25417 consensus_queue.cc:1046] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.118s
I20260807 13:41:03.550930 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:03.552165 23600 raft_consensus.cc:2396] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:41:03.524324 25284 raft_consensus.cc:482] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:41:03.563868 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:03.480264 25433 consensus_queue.cc:1046] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260807 13:41:03.513592 25361 raft_consensus.cc:504] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.582823 23598 raft_consensus.cc:2454] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:41:03.583033 23600 raft_consensus.cc:1226] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:03.497028 25418 consensus_queue.cc:1046] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260807 13:41:03.530491 25092 raft_consensus.cc:504] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.586983 25430 raft_consensus.cc:3032] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:41:03.587381 25430 raft_consensus.cc:729] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:03.562331 25269 raft_consensus.cc:2726] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 13:41:03.550791 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:03.584383 25368 ts_tablet_manager.cc:1428] T 7a180725c9e34d0095ab423614678d88 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent starting tablet: real 0.573s user 0.009s sys 0.002s
I20260807 13:41:03.592572 23600 raft_consensus.cc:1226] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4. Ops: []
W20260807 13:41:03.594209 25422 log.cc:924] Time spent T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.181s user 0.000s sys 0.001s
I20260807 13:41:03.594851 25430 consensus_queue.cc:260] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.596081 25409 raft_consensus.cc:3032] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:41:03.585951 25388 consensus_queue.cc:1046] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
W20260807 13:41:03.609835 25413 log.cc:924] Time spent T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.306s user 0.002s sys 0.000s
I20260807 13:41:03.577003 25284 raft_consensus.cc:3037] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:03.612644 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:03.590907 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
W20260807 13:41:03.613207 23554 leader_election.cc:341] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Illegal state: Tablet not RUNNING: STOPPED
I20260807 13:41:03.615522 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:03.659195 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:03.659925 23598 raft_consensus.cc:2454] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
W20260807 13:41:03.614470 25368 ts_tablet_manager.cc:1460] T 7a180725c9e34d0095ab423614678d88 P 08757cfbeffb41bbab14c2ef00e9d812: Tablet startup took 603ms
I20260807 13:41:03.660992 23554 leader_election.cc:302] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:41:03.663849 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:03.619246 25409 raft_consensus.cc:729] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:03.614658 24739 consensus_queue.cc:1046] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260807 13:41:03.670643 23598 raft_consensus.cc:2454] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:03.671021 23591 raft_consensus.cc:1226] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4. Ops: []
W20260807 13:41:03.671000 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 59070.4us
I20260807 13:41:03.658506 25420 raft_consensus.cc:482] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:03.676116 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
W20260807 13:41:03.678823 25421 log.cc:924] Time spent T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.164s user 0.000s sys 0.002s
W20260807 13:41:03.679597 25425 log.cc:924] Time spent T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.215s user 0.001s sys 0.000s
I20260807 13:41:03.682730 25092 leader_election.cc:288] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:41:03.683418 23554 raft_consensus.cc:2670] T 1f8a5f186bf1473a988921e5efa3e574 P 08757cfbeffb41bbab14c2ef00e9d812: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260807 13:41:03.683224 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:03.684870 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:03.686208 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:03.687623 25062 raft_consensus.cc:3032] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:41:03.689090 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:03.690212 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
W20260807 13:41:03.690968 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 77814.9us
I20260807 13:41:03.700291 25361 leader_election.cc:288] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:03.701213 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:03.701869 25280 leader_election.cc:288] T 7a180725c9e34d0095ab423614678d88 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:03.703292 25409 consensus_queue.cc:260] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.668064 25430 raft_consensus.cc:3037] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:03.705107 25394 raft_consensus.cc:3032] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:41:03.708168 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:03.708431 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c1184114b02410098331e68d3b8d4cf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:03.750435 23597 raft_consensus.cc:2379] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:41:03.709182 23598 raft_consensus.cc:1226] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3. Ops: []
I20260807 13:41:03.709129 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:03.719509 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
W20260807 13:41:03.746824 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 334592us
I20260807 13:41:03.747460 23554 leader_election.cc:302] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:41:03.752012 23600 raft_consensus.cc:3037] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:03.751922 23591 raft_consensus.cc:2454] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:03.673875 25000 leader_election.cc:288] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:03.771288 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:03.713411 25062 raft_consensus.cc:729] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:41:03.770203 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:03.709419 25420 raft_consensus.cc:504] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:41:03.780522 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 60894.2us
I20260807 13:41:03.745078 25440 raft_consensus.cc:482] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:03.786461 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:03.698288 25284 raft_consensus.cc:504] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.793953 23704 raft_consensus.cc:1226] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:03.794054 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:03.795396 23702 raft_consensus.cc:1226] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 4. Current term is 5. Ops: []
I20260807 13:41:03.796272 23704 raft_consensus.cc:1261] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:41:03.796553 23702 raft_consensus.cc:1261] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:41:03.797354 23704 raft_consensus.cc:1226] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:03.797595 23702 raft_consensus.cc:1226] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 LEADER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:03.749612 25394 raft_consensus.cc:729] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
W20260807 13:41:03.808419 23660 leader_election.cc:341] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Not found: Tablet not found: 1f8a5f186bf1473a988921e5efa3e574
I20260807 13:41:03.811198 23660 leader_election.cc:302] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
W20260807 13:41:03.811995 23660 raft_consensus.cc:2670] T 1f8a5f186bf1473a988921e5efa3e574 P 8a3af1d071e74f2eb0c821e2bd68fe37: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260807 13:41:03.818117 23660 leader_election.cc:302] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:03.788805 25000 raft_consensus.cc:3032] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:41:03.789757 25209 consensus_queue.cc:1035] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260807 13:41:03.791837 25280 raft_consensus.cc:2726] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:41:03.826191 25420 leader_election.cc:288] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:03.786120 25446 raft_consensus.cc:482] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:03.807312 25440 raft_consensus.cc:504] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.828029 25062 consensus_queue.cc:260] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.831282 25062 raft_consensus.cc:3037] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:03.832757 25446 raft_consensus.cc:504] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.835485 25092 raft_consensus.cc:482] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:03.836069 25092 raft_consensus.cc:504] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
@ 0x7f4619374e90 testing::internal::HandleExceptionsInMethodIfSupported<>() at ??:0
I20260807 13:41:03.837620 25394 consensus_queue.cc:260] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.838989 25394 raft_consensus.cc:3037] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
W20260807 13:41:03.664752 25368 ts_tablet_manager.cc:1462] T 7a180725c9e34d0095ab423614678d88 P 08757cfbeffb41bbab14c2ef00e9d812: Trace:
0807 13:41:00.415248 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:00.420982 (+ 5734us) service_pool.cc:227] Handling call
0807 13:41:01.022183 (+601201us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:41:01.022327 (+ 144us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:41:01.437413 (+415086us) tablet_metadata.cc:641] Metadata flushed
0807 13:41:01.922023 (+484610us) tablet_replica.cc:205] Creating consensus instance
0807 13:41:02.125344 (+203321us) inbound_call.cc:173] Queueing success response
0807 13:41:02.125350 (+ 6us) ts_tablet_manager.cc:1373] Bootstrapping tablet
0807 13:41:03.011184 (+885834us) ts_tablet_manager.cc:1429] Starting tablet replica
0807 13:41:03.075387 (+ 64203us) tablet_replica.cc:259] Starting instrumentation
0807 13:41:03.075991 (+ 604us) tablet_replica.cc:278] Starting consensus
Metrics: {"raft.queue_time_us":160,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":6348,"spinlock_wait_cycles":9600,"tablet-open.queue_time_us":193716,"thread_start_us":193238,"threads_started":1}
W20260807 13:41:03.840338 25435 log.cc:924] Time spent T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.176s user 0.002s sys 0.000s
I20260807 13:41:03.841025 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
W20260807 13:41:03.841501 25429 log.cc:924] Time spent T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.256s user 0.001s sys 0.000s
I20260807 13:41:03.841624 25423 raft_consensus.cc:3032] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:41:03.842056 25423 raft_consensus.cc:729] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:03.808084 24905 leader_election.cc:288] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:03.827544 25000 raft_consensus.cc:729] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:03.820068 25409 raft_consensus.cc:3037] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:41:03.843878 25000 consensus_queue.cc:260] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.844928 25000 raft_consensus.cc:3037] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Advancing to term 5
W20260807 13:41:03.844015 25434 log.cc:924] Time spent T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.329s user 0.002s sys 0.000s
I20260807 13:41:03.846073 25417 consensus_queue.cc:1046] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:41:03.847375 25417 raft_consensus.cc:2726] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:03.847718 23590 raft_consensus.cc:1226] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:03.848016 25417 raft_consensus.cc:3032] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:41:03.848440 25417 raft_consensus.cc:729] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:03.852948 25449 consensus_queue.cc:1046] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260807 13:41:03.855042 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 140891us
W20260807 13:41:03.900204 23535 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:41:03.902323 23554 leader_election.cc:302] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:41:03.908896 25092 leader_election.cc:288] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:03.909552 25092 raft_consensus.cc:482] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:03.849403 25417 consensus_queue.cc:260] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.910547 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:03.911073 25417 raft_consensus.cc:3037] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:03.911486 23597 raft_consensus.cc:2379] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 4: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
W20260807 13:41:03.911875 25427 log.cc:924] Time spent T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.251s user 0.000s sys 0.001s
I20260807 13:41:03.912432 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:03.913030 23591 raft_consensus.cc:2454] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:03.902326 25070 consensus_queue.cc:1035] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260807 13:41:03.887605 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:03.914112 23588 raft_consensus.cc:2454] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:03.912833 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:03.919880 23595 raft_consensus.cc:1261] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 4 index: 1. (index mismatch)
I20260807 13:41:03.917896 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a180725c9e34d0095ab423614678d88" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:03.921272 23594 raft_consensus.cc:2454] T 7a180725c9e34d0095ab423614678d88 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 0.
I20260807 13:41:03.926316 23591 raft_consensus.cc:1261] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:41:03.910024 25092 raft_consensus.cc:504] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.927541 23704 raft_consensus.cc:1226] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 LEADER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 4. Current term is 5. Ops: []
I20260807 13:41:03.928977 25415 raft_consensus.cc:3032] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:41:03.929316 25415 raft_consensus.cc:729] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:03.929965 25415 consensus_queue.cc:260] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.930948 25415 raft_consensus.cc:3037] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:03.933914 25416 raft_consensus.cc:3032] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:41:03.934247 25433 raft_consensus.cc:3032] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:41:03.934949 25433 raft_consensus.cc:729] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
W20260807 13:41:03.936044 25426 log.cc:924] Time spent T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.442s user 0.000s sys 0.001s
I20260807 13:41:03.936132 25433 consensus_queue.cc:260] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.937496 24739 raft_consensus.cc:3032] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:41:03.937798 24739 raft_consensus.cc:729] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:41:03.937805 25433 raft_consensus.cc:3037] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:03.938809 24739 consensus_queue.cc:260] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.924990 25284 leader_election.cc:288] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:03.943346 23594 raft_consensus.cc:1261] T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260807 13:41:03.950361 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 55455.2us
I20260807 13:41:03.961828 23554 leader_election.cc:302] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:41:03.934321 25416 raft_consensus.cc:729] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:03.966851 23554 leader_election.cc:302] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:41:03.927016 25280 raft_consensus.cc:2726] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:41:03.971585 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:03.952527 24739 raft_consensus.cc:3037] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:03.967463 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:03.974203 23769 leader_election.cc:398] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833) with higher term. Message: Invalid argument: T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 for earlier term 2. Current term is 3.
I20260807 13:41:03.987197 23554 leader_election.cc:302] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:41:04.000854 23600 raft_consensus.cc:2454] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:03.985093 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:03.963932 25454 raft_consensus.cc:3032] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:41:04.016399 23702 raft_consensus.cc:2454] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:41:04.020974 23711 raft_consensus.cc:2379] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 4: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:41:04.015962 23769 leader_election.cc:401] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260807 13:41:03.973351 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 155346us
I20260807 13:41:03.992278 25092 leader_election.cc:288] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:03.978266 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:03.981660 23662 leader_election.cc:302] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:04.021960 23555 leader_election.cc:302] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:04.024842 23660 leader_election.cc:302] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:04.024971 23555 leader_election.cc:302] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:03.987939 25438 consensus_queue.cc:1035] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260807 13:41:03.975183 25038 raft_consensus.cc:2726] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:41:04.027282 25415 raft_consensus.cc:2781] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election won for term 2
W20260807 13:41:03.974822 25445 log.cc:924] Time spent T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da: Append to log took a long time: real 0.064s user 0.000s sys 0.002s
I20260807 13:41:03.992657 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:04.035511 23700 raft_consensus.cc:2379] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 5: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:41:04.031281 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:04.034082 23662 leader_election.cc:302] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:03.987519 25070 raft_consensus.cc:2726] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:41:03.963478 25284 consensus_queue.cc:1035] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260807 13:41:03.986568 25440 leader_election.cc:288] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:04.042860 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a180725c9e34d0095ab423614678d88" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:04.043123 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:04.020665 25454 raft_consensus.cc:729] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:04.045558 23702 raft_consensus.cc:2454] T 7a180725c9e34d0095ab423614678d88 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 0.
I20260807 13:41:04.030257 25361 raft_consensus.cc:2781] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:41:03.977463 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:03.970288 25419 raft_consensus.cc:482] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:04.032403 25451 raft_consensus.cc:482] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:03.987907 25446 leader_election.cc:288] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:03.973460 25433 consensus_queue.cc:1035] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.071s
I20260807 13:41:04.060745 24905 raft_consensus.cc:2726] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:41:04.062942 25451 raft_consensus.cc:504] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.065677 25451 leader_election.cc:288] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:04.048553 25440 consensus_queue.cc:1046] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260807 13:41:04.066776 25440 raft_consensus.cc:3032] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:41:04.067095 25440 raft_consensus.cc:729] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:04.067971 23660 leader_election.cc:302] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:04.067929 25440 consensus_queue.cc:260] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.069422 25440 raft_consensus.cc:3037] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:04.074847 25433 raft_consensus.cc:2726] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 13:41:04.074862 25419 raft_consensus.cc:504] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:41:04.077581 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 103540us
I20260807 13:41:03.924796 25423 consensus_queue.cc:260] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:03.988124 25388 consensus_queue.cc:1035] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260807 13:41:04.051914 23772 leader_election.cc:302] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:04.036010 25038 raft_consensus.cc:2781] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:04.052645 23662 leader_election.cc:302] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:04.030637 25316 consensus_queue.cc:1046] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260807 13:41:04.043586 25092 raft_consensus.cc:2726] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833) with higher term. Message: Invalid argument: T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 for earlier term 2. Current term is 3.
I20260807 13:41:04.078585 23660 leader_election.cc:302] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:04.083025 23662 leader_election.cc:302] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:04.084683 25459 raft_consensus.cc:2726] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:41:04.085377 23772 leader_election.cc:302] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:04.086545 23772 leader_election.cc:302] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:04.086874 25452 raft_consensus.cc:2726] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:41:04.087529 25452 raft_consensus.cc:2781] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:41:04.087977 25455 raft_consensus.cc:2781] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:04.088025 23772 leader_election.cc:302] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:04.088511 25455 raft_consensus.cc:482] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:04.088930 25455 raft_consensus.cc:3037] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:04.089017 25446 raft_consensus.cc:2726] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:41:04.090170 23772 leader_election.cc:302] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:04.086196 25459 consensus_queue.cc:1046] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:41:04.081007 25038 raft_consensus.cc:482] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:04.090905 25038 raft_consensus.cc:3037] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:04.091212 25449 raft_consensus.cc:3032] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:41:04.091621 25449 raft_consensus.cc:729] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:04.051461 25418 raft_consensus.cc:2781] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:41:04.092152 25418 raft_consensus.cc:482] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:04.081349 25458 consensus_queue.cc:1046] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260807 13:41:04.092510 25449 consensus_queue.cc:260] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.093888 25449 raft_consensus.cc:3037] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:04.087951 25452 raft_consensus.cc:686] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:04.092519 25418 raft_consensus.cc:3037] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:03.980671 25416 consensus_queue.cc:260] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.095110 25452 consensus_queue.cc:237] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.095757 25416 raft_consensus.cc:3037] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:04.047418 25415 raft_consensus.cc:686] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:04.052105 25361 raft_consensus.cc:482] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:41:04.091246 25092 raft_consensus.cc:2781] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:41:04.099345 25092 raft_consensus.cc:686] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
W20260807 13:41:04.096415 25158 consensus_queue.cc:1159] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "08757cfbeffb41bbab14c2ef00e9d812" responder_term: 4 status { last_received { term: 3 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260807 13:41:04.100332 25092 consensus_queue.cc:237] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.099382 25361 raft_consensus.cc:3037] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:41:04.101667 25419 leader_election.cc:288] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:04.102623 25454 consensus_queue.cc:260] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.103297 25316 raft_consensus.cc:2781] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:04.103749 25316 raft_consensus.cc:482] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:04.103811 25443 raft_consensus.cc:3032] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:41:04.104120 25316 raft_consensus.cc:3037] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:04.104552 25443 raft_consensus.cc:729] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:04.115948 23772 leader_election.cc:302] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:04.118908 25419 consensus_queue.cc:1046] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:41:04.120378 23662 leader_election.cc:302] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:04.121680 23662 leader_election.cc:302] T 7a180725c9e34d0095ab423614678d88 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:04.123500 25209 consensus_queue.cc:1035] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:41:04.123435 25443 consensus_queue.cc:260] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.124711 24905 raft_consensus.cc:2726] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 13:41:04.125119 25443 raft_consensus.cc:3037] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:04.123473 25419 raft_consensus.cc:2781] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:04.125707 25419 raft_consensus.cc:482] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:04.126049 25419 raft_consensus.cc:3037] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:04.127358 25446 raft_consensus.cc:2726] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 13:41:04.128275 25409 raft_consensus.cc:2781] T 7a180725c9e34d0095ab423614678d88 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:41:04.128661 25409 raft_consensus.cc:482] T 7a180725c9e34d0095ab423614678d88 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:04.129015 25409 raft_consensus.cc:3037] T 7a180725c9e34d0095ab423614678d88 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:41:04.129824 25423 raft_consensus.cc:3037] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:04.130064 25446 consensus_queue.cc:1046] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:41:04.131026 25446 raft_consensus.cc:3032] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:41:04.131350 25446 raft_consensus.cc:729] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
W20260807 13:41:04.131449 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 49503.9us
I20260807 13:41:04.133317 25451 consensus_queue.cc:1046] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:41:04.135473 25446 consensus_queue.cc:260] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
I20260807 13:41:04.101724 25415 consensus_queue.cc:237] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.129841 25459 consensus_queue.cc:1046] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
W20260807 13:41:04.138329 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 59824.4us
I20260807 13:41:04.139472 23660 leader_election.cc:302] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:41:04.141131 23660 leader_election.cc:302] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
W20260807 13:41:04.142324 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 104822us
I20260807 13:41:04.143617 23555 leader_election.cc:302] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:04.130183 23772 leader_election.cc:302] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:04.103829 25454 raft_consensus.cc:3037] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:04.137259 25446 raft_consensus.cc:3037] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:04.148200 23660 leader_election.cc:302] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:04.150616 24905 raft_consensus.cc:2726] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:41:04.153954 23660 leader_election.cc:302] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:41:04.144583 25458 raft_consensus.cc:2781] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:04.163586 25476 raft_consensus.cc:3032] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:41:04.163977 25476 raft_consensus.cc:729] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:04.163745 25459 raft_consensus.cc:3032] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:41:04.164487 25459 raft_consensus.cc:729] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:04.164849 25476 consensus_queue.cc:260] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.157166 25158 raft_consensus.cc:3037] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:04.175522 25316 raft_consensus.cc:504] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.149276 25418 raft_consensus.cc:504] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.175680 23660 leader_election.cc:302] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:04.144927 25354 raft_consensus.cc:3032] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:41:04.189015 23660 leader_election.cc:398] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Vote denied by peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685) with higher term. Message: Invalid argument: T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
I20260807 13:41:04.189366 23660 leader_election.cc:401] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260807 13:41:04.177636 25316 leader_election.cc:288] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:04.194639 25414 raft_consensus.cc:2726] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260807 13:41:04.196074 23554 leader_election.cc:334] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Timed out: RequestConsensusVote RPC to 127.21.82.67:46685 timed out after 1.659s (SENT)
I20260807 13:41:04.167351 25458 raft_consensus.cc:482] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:04.156716 25352 raft_consensus.cc:2781] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:41:04.168246 25280 raft_consensus.cc:3037] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:04.180661 25449 raft_consensus.cc:2781] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:41:04.186473 25354 raft_consensus.cc:729] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:04.215916 23554 leader_election.cc:302] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:41:04.184139 24905 raft_consensus.cc:2781] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:41:04.219818 25458 raft_consensus.cc:3037] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Advancing to term 5
W20260807 13:41:04.249258 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 60414.8us
I20260807 13:41:04.251230 23660 leader_election.cc:302] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:04.253988 23660 leader_election.cc:302] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:04.202615 25316 raft_consensus.cc:2726] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685) with higher term. Message: Invalid argument: T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
I20260807 13:41:04.255880 23660 leader_election.cc:302] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:41:04.260234 23769 leader_election.cc:302] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:04.261650 23660 leader_election.cc:302] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:04.225986 25418 leader_election.cc:288] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:04.227669 23699 raft_consensus.cc:2454] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 4.
I20260807 13:41:04.220561 25449 raft_consensus.cc:686] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:04.234954 25388 raft_consensus.cc:2726] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:41:04.220355 25352 raft_consensus.cc:482] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:04.165601 25459 consensus_queue.cc:260] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.272128 23769 leader_election.cc:302] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:04.220782 24905 raft_consensus.cc:482] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:41:04.271263 25440 raft_consensus.cc:482] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
W20260807 13:41:04.278622 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 148519us
I20260807 13:41:04.280153 23769 leader_election.cc:302] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:04.266026 25416 raft_consensus.cc:2726] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:41:04.268028 25000 raft_consensus.cc:2781] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:41:04.273029 25417 raft_consensus.cc:2726] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:41:04.271256 25316 raft_consensus.cc:3037] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:04.275416 25352 raft_consensus.cc:3037] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:04.278000 24905 raft_consensus.cc:3037] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:41:04.301321 25449 consensus_queue.cc:237] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.277118 25414 consensus_queue.cc:1035] T daaea1dffb5443f4858c40ca25e7830e P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260807 13:41:04.303881 23660 leader_election.cc:302] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:41:04.305047 23660 leader_election.cc:302] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:41:04.306967 23660 leader_election.cc:302] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:41:04.273005 25409 raft_consensus.cc:504] T 7a180725c9e34d0095ab423614678d88 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.310024 25409 leader_election.cc:288] T 7a180725c9e34d0095ab423614678d88 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:04.311862 23660 leader_election.cc:398] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Vote denied by peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685) with higher term. Message: Invalid argument: T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
I20260807 13:41:04.288620 25000 raft_consensus.cc:482] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:04.312273 23660 leader_election.cc:401] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260807 13:41:04.293753 25451 raft_consensus.cc:2726] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:41:04.319940 25458 raft_consensus.cc:504] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.322211 25458 leader_election.cc:288] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:04.307837 25459 raft_consensus.cc:3037] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:41:04.327761 23660 leader_election.cc:302] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:41:04.281821 25440 raft_consensus.cc:504] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.338035 25478 raft_consensus.cc:2726] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:41:04.338797 25409 raft_consensus.cc:2781] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:04.315021 25000 raft_consensus.cc:3037] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:04.310770 25417 raft_consensus.cc:2781] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:41:04.311947 25423 raft_consensus.cc:2781] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:04.307453 25475 raft_consensus.cc:2726] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:04.313001 25416 raft_consensus.cc:2781] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:41:04.346932 23660 leader_election.cc:302] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:04.287249 25354 consensus_queue.cc:260] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.311350 25452 consensus_queue.cc:1046] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.037s
I20260807 13:41:04.323694 25418 consensus_queue.cc:1035] T c9552d42b445450691daef21fba4059a P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260807 13:41:04.372394 23660 leader_election.cc:302] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:04.350520 25409 raft_consensus.cc:482] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:04.335422 25458 raft_consensus.cc:2726] T e6df7e3fe3a74e6d818aeb532b42d6ba P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685) with higher term. Message: Invalid argument: T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 2. Current term is 3.
I20260807 13:41:04.379514 25476 raft_consensus.cc:3037] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:04.387490 25158 raft_consensus.cc:2726] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:04.354259 25455 raft_consensus.cc:504] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.395263 25452 raft_consensus.cc:3032] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:41:04.396402 25354 raft_consensus.cc:3037] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:04.352471 25423 raft_consensus.cc:482] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:04.399262 25430 raft_consensus.cc:482] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:04.399825 25408 raft_consensus.cc:482] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:04.405915 25409 raft_consensus.cc:3037] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:04.349516 25451 consensus_queue.cc:1046] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260807 13:41:04.350378 25417 raft_consensus.cc:482] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:04.357357 25416 raft_consensus.cc:482] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:04.369038 25414 raft_consensus.cc:2726] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260807 13:41:04.422540 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 142724us
I20260807 13:41:04.401326 25038 raft_consensus.cc:504] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.405303 25443 raft_consensus.cc:2726] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:04.429672 23448 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37962 (request call id 139) took 1889 ms. Trace:
I20260807 13:41:04.416669 25452 raft_consensus.cc:729] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:04.427747 25423 raft_consensus.cc:3037] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Advancing to term 5
W20260807 13:41:04.459146 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 204943us
I20260807 13:41:04.432825 25417 raft_consensus.cc:3037] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:04.443192 25416 raft_consensus.cc:3037] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:04.408879 25419 raft_consensus.cc:504] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.462030 23772 leader_election.cc:302] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:04.466064 23555 leader_election.cc:302] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:04.456717 25451 raft_consensus.cc:482] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:04.433744 25430 raft_consensus.cc:504] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.433246 25408 raft_consensus.cc:504] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.480415 25440 leader_election.cc:288] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:04.463323 25092 consensus_queue.cc:1035] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.015s
I20260807 13:41:04.489995 25038 leader_election.cc:288] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:04.464504 25454 consensus_queue.cc:1035] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260807 13:41:04.475930 25449 raft_consensus.cc:2781] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election won for term 4
@ 0x7f4619352a92 testing::Test::Run() at ??:0
I20260807 13:41:04.509188 25408 leader_election.cc:288] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:04.519376 25092 raft_consensus.cc:482] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:04.513388 23555 leader_election.cc:302] T 7a180725c9e34d0095ab423614678d88 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:04.448208 23448 rpcz_store.cc:276] 0807 13:41:02.535418 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:02.535721 (+ 303us) service_pool.cc:227] Handling call
0807 13:41:04.425030 (+1889309us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:41:03.289126 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:41:03.460475 (+171349us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:41:03.479788 (+ 19313us) write_op.cc:435] Acquired schema lock
0807 13:41:03.493773 (+ 13985us) tablet.cc:660] Decoding operations
0807 13:41:03.598970 (+105197us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:41:03.599125 (+ 155us) write_op.cc:641] Partition lock acquired for write op
0807 13:41:03.599164 (+ 39us) tablet.cc:683] Acquiring locks for 11 operations
0807 13:41:03.600617 (+ 1453us) tablet.cc:699] Row locks acquired
0807 13:41:03.600664 (+ 47us) write_op.cc:260] PREPARE: finished
0807 13:41:03.600883 (+ 219us) write_op.cc:270] Start()
0807 13:41:03.601068 (+ 185us) write_op.cc:276] Timestamp: P: 1786110063600818 usec, L: 0
0807 13:41:03.601109 (+ 41us) op_driver.cc:331] REPLICATION: starting
0807 13:41:03.601986 (+ 877us) log.cc:842] Serialized 4388 byte log entry
0807 13:41:04.151296 (+549310us) op_driver.cc:444] REPLICATION: finished
0807 13:41:04.335505 (+184209us) write_op.cc:301] APPLY: starting
0807 13:41:04.335616 (+ 111us) tablet.cc:1365] starting BulkCheckPresence
0807 13:41:04.335929 (+ 313us) tablet.cc:1368] finished BulkCheckPresence
0807 13:41:04.336117 (+ 188us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:41:04.337819 (+ 1702us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:41:04.338202 (+ 383us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0807 13:41:04.338269 (+ 67us) write_op.cc:312] APPLY: finished
0807 13:41:04.338941 (+ 672us) log.cc:842] Serialized 82 byte log entry
0807 13:41:04.339923 (+ 982us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:41:04.340096 (+ 173us) write_op.cc:454] Released schema lock
0807 13:41:04.340176 (+ 80us) write_op.cc:341] FINISH: Updating metrics
0807 13:41:04.345291 (+ 5115us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:41:04.345324 (+ 33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":153331,"apply.run_cpu_time_us":4803,"apply.run_wall_time_us":31258,"num_ops":11,"prepare.queue_time_us":180572,"prepare.run_cpu_time_us":82267,"prepare.run_wall_time_us":497481,"raft.queue_time_us":91356,"raft.run_cpu_time_us":12578,"raft.run_wall_time_us":123247,"replication_time_us":550058,"thread_start_us":468312,"threads_started":4,"wal-append.queue_time_us":308041}]]}
I20260807 13:41:04.501097 25469 raft_consensus.cc:2741] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260807 13:41:04.529976 25361 raft_consensus.cc:504] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.531339 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:04.532155 25361 leader_election.cc:288] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:04.533150 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:04.534399 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:04.461462 25478 consensus_queue.cc:1046] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260807 13:41:04.537195 23662 leader_election.cc:302] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:04.536003 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:04.539366 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:04.535321 25494 raft_consensus.cc:2781] T 7a180725c9e34d0095ab423614678d88 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:41:04.541488 25494 raft_consensus.cc:482] T 7a180725c9e34d0095ab423614678d88 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:04.541844 25494 raft_consensus.cc:3037] T 7a180725c9e34d0095ab423614678d88 P 08757cfbeffb41bbab14c2ef00e9d812 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:41:04.542377 25415 raft_consensus.cc:2781] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:04.542836 25415 raft_consensus.cc:482] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:04.543177 25415 raft_consensus.cc:3037] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:04.543651 25418 consensus_queue.cc:1035] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:41:04.545106 25418 consensus_queue.cc:1035] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:41:04.535892 25449 raft_consensus.cc:686] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:04.475598 25451 raft_consensus.cc:504] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.549238 25475 raft_consensus.cc:3032] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:41:04.566447 25475 raft_consensus.cc:729] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:04.567355 25475 consensus_queue.cc:260] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.568557 25475 raft_consensus.cc:3037] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:04.501929 25452 consensus_queue.cc:260] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.549942 25449 consensus_queue.cc:237] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.551290 25478 raft_consensus.cc:3032] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:41:04.552676 25158 raft_consensus.cc:482] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:04.571420 25478 raft_consensus.cc:729] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:04.571733 25158 raft_consensus.cc:504] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.573714 25451 leader_election.cc:288] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:04.573848 25158 leader_election.cc:288] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:04.542423 23662 leader_election.cc:302] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:04.574536 25478 consensus_queue.cc:260] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.575847 25478 raft_consensus.cc:3037] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:04.576771 25158 raft_consensus.cc:2781] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:41:04.577334 25158 raft_consensus.cc:686] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:04.524708 25316 raft_consensus.cc:2726] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:04.578437 25158 consensus_queue.cc:237] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.535849 25092 raft_consensus.cc:504] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.580754 25092 leader_election.cc:288] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:04.583463 23449 catalog_manager.cc:5495] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 2 to 4, leader changed from d28e736aee9f4f01b013de670a762697 (127.21.82.67) to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 4 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:41:04.571094 25452 raft_consensus.cc:3037] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:04.589509 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:04.590231 23705 raft_consensus.cc:3037] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:04.589891 25415 raft_consensus.cc:504] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.554023 24905 raft_consensus.cc:504] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.600993 24905 leader_election.cc:288] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:04.560240 25280 raft_consensus.cc:2726] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:41:04.560851 25455 leader_election.cc:288] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:04.561204 25352 raft_consensus.cc:504] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.491479 25503 consensus_queue.cc:1046] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
I20260807 13:41:04.609932 25503 raft_consensus.cc:3032] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:41:04.610318 25503 raft_consensus.cc:729] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:04.563802 25430 leader_election.cc:288] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:04.564179 25417 raft_consensus.cc:504] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.564764 25419 leader_election.cc:288] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:04.565143 25000 raft_consensus.cc:504] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.595263 23449 catalog_manager.cc:5495] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 2 to 4, leader changed from d28e736aee9f4f01b013de670a762697 (127.21.82.67) to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 4 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
W20260807 13:41:04.598044 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 317958us
I20260807 13:41:04.603247 23702 raft_consensus.cc:1226] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 4. Current term is 5. Ops: []
I20260807 13:41:04.605077 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:04.617655 23769 leader_election.cc:302] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:04.619448 23769 leader_election.cc:302] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:04.620316 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:04.620982 23600 raft_consensus.cc:3037] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:04.621079 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:04.621860 23599 raft_consensus.cc:2454] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
W20260807 13:41:04.619199 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 173151us
I20260807 13:41:04.611186 25503 consensus_queue.cc:260] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:41:04.623912 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 160064us
I20260807 13:41:04.611979 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:04.624583 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:04.624393 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:04.629729 23449 catalog_manager.cc:5495] T 7800087414314b9983dee88fd1b6ccb5 P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 1 to 3, leader changed from d28e736aee9f4f01b013de670a762697 (127.21.82.67) to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 3 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:41:04.635857 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:04.627609 23703 raft_consensus.cc:1226] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:04.637156 23594 raft_consensus.cc:3037] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:04.636759 23591 raft_consensus.cc:2379] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 4: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:41:04.637411 23449 catalog_manager.cc:5495] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 1 to 3, leader changed from d28e736aee9f4f01b013de670a762697 (127.21.82.67) to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 3 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
W20260807 13:41:04.624017 23554 leader_election.cc:334] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Timed out: RequestConsensusVote RPC to 127.21.82.67:46685 timed out after 1.949s (SENT)
I20260807 13:41:04.607398 25415 leader_election.cc:288] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:04.637982 23772 leader_election.cc:302] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:04.641970 23769 leader_election.cc:302] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:04.617214 25459 raft_consensus.cc:482] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:04.655287 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:04.653479 23662 leader_election.cc:302] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:04.656461 23591 raft_consensus.cc:2454] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:04.639467 23449 catalog_manager.cc:5495] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d28e736aee9f4f01b013de670a762697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } }
I20260807 13:41:04.659165 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:04.660643 23710 raft_consensus.cc:2379] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 4: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:41:04.628628 25417 leader_election.cc:288] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:04.668677 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "830e8cb8ce434e6391c09530c677a61d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:04.657994 23699 raft_consensus.cc:1226] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:04.626189 25352 leader_election.cc:288] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:04.622032 25416 raft_consensus.cc:504] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.627188 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a180725c9e34d0095ab423614678d88" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:04.672418 23600 raft_consensus.cc:2454] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 5.
I20260807 13:41:04.672609 23595 raft_consensus.cc:2379] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 2: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:41:04.652141 25092 raft_consensus.cc:2726] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:41:04.674041 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:04.604926 25494 raft_consensus.cc:504] T 7a180725c9e34d0095ab423614678d88 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.675127 23769 leader_election.cc:302] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:04.673161 23449 catalog_manager.cc:5495] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 2 to 4, leader changed from d28e736aee9f4f01b013de670a762697 (127.21.82.67) to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 4 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:41:04.681166 23591 raft_consensus.cc:3037] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:04.679929 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:04.681663 23449 catalog_manager.cc:5495] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 1 to 3, leader changed from d28e736aee9f4f01b013de670a762697 (127.21.82.67) to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 3 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:41:04.683313 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:04.621584 25409 raft_consensus.cc:504] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.671877 25269 raft_consensus.cc:482] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:41:04.668814 25503 raft_consensus.cc:3037] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:41:04.669637 25415 raft_consensus.cc:2781] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:41:04.690124 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:04.690965 23595 raft_consensus.cc:3037] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:04.691383 23707 raft_consensus.cc:1226] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:04.684692 23449 catalog_manager.cc:5495] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 2 to 3, leader changed from d28e736aee9f4f01b013de670a762697 (127.21.82.67) to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 3 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
W20260807 13:41:04.699050 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 46029.7us
I20260807 13:41:04.679677 25451 raft_consensus.cc:2726] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 13:41:04.688687 25415 raft_consensus.cc:482] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:04.658324 25459 raft_consensus.cc:504] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.694536 23449 catalog_manager.cc:5495] T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 1 to 3, leader changed from d28e736aee9f4f01b013de670a762697 (127.21.82.67) to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 3 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:41:04.686432 25440 raft_consensus.cc:2781] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:41:04.704571 23449 catalog_manager.cc:5495] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 1 to 4, leader changed from d28e736aee9f4f01b013de670a762697 (127.21.82.67) to 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65). New cstate: current_term: 4 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:41:04.707635 23591 raft_consensus.cc:2454] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 5.
I20260807 13:41:04.707760 23449 catalog_manager.cc:5495] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "08757cfbeffb41bbab14c2ef00e9d812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } health_report { overall_health: UNKNOWN } } }
I20260807 13:41:04.709897 23772 leader_election.cc:302] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:04.703222 25513 raft_consensus.cc:2726] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:41:04.709060 25449 consensus_queue.cc:1035] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
W20260807 13:41:04.712183 25511 log.cc:924] Time spent T e6df7e3fe3a74e6d818aeb532b42d6ba P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.059s user 0.000s sys 0.000s
I20260807 13:41:04.713001 25038 consensus_queue.cc:1046] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:41:04.713380 25388 consensus_queue.cc:1046] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:41:04.713836 25062 consensus_queue.cc:1046] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:41:04.714262 25388 raft_consensus.cc:3032] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:41:04.714630 25388 raft_consensus.cc:729] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:41:04.714936 25062 raft_consensus.cc:3032] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:41:04.715416 25062 raft_consensus.cc:729] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:41:04.715514 25388 consensus_queue.cc:260] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.716362 23662 leader_election.cc:302] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:04.716877 25388 raft_consensus.cc:3037] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:04.716318 25062 consensus_queue.cc:260] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.718242 25062 raft_consensus.cc:3037] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:04.718878 25394 consensus_queue.cc:1046] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:41:04.721297 25495 raft_consensus.cc:3032] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:41:04.721861 25495 raft_consensus.cc:729] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:41:04.721877 23662 leader_election.cc:302] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:04.713840 25038 raft_consensus.cc:3032] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:41:04.723613 25443 raft_consensus.cc:2781] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:04.724041 25417 raft_consensus.cc:2781] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:41:04.724201 25443 raft_consensus.cc:482] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:04.723577 25038 raft_consensus.cc:729] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:41:04.724824 25443 raft_consensus.cc:3037] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:04.724915 25417 raft_consensus.cc:686] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:04.725349 25038 consensus_queue.cc:260] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.726897 25038 raft_consensus.cc:3037] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:04.728467 23662 leader_election.cc:302] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:04.729179 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:04.729624 25354 raft_consensus.cc:2781] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:41:04.730443 25354 raft_consensus.cc:686] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:04.732043 25354 consensus_queue.cc:237] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.734977 23588 raft_consensus.cc:2379] T 7a180725c9e34d0095ab423614678d88 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 1: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:41:04.735244 25495 consensus_queue.cc:260] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.737296 25495 raft_consensus.cc:3037] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:04.737555 23591 raft_consensus.cc:1261] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:41:04.738914 25524 raft_consensus.cc:2726] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:04.738518 25443 raft_consensus.cc:504] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.747375 23595 raft_consensus.cc:2454] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 5.
I20260807 13:41:04.748553 23662 leader_election.cc:302] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:04.726511 25417 consensus_queue.cc:237] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.705629 25415 raft_consensus.cc:3037] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:41:04.757694 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 52013us
I20260807 13:41:04.758740 23594 raft_consensus.cc:2454] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 5.
I20260807 13:41:04.760943 23772 leader_election.cc:302] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:04.695483 25269 raft_consensus.cc:504] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.764031 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:04.764212 23662 leader_election.cc:302] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:04.766551 25443 leader_election.cc:288] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:04.769400 23591 raft_consensus.cc:3037] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:04.759485 25419 raft_consensus.cc:2781] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:41:04.705132 25454 consensus_queue.cc:1046] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260807 13:41:04.760771 25451 raft_consensus.cc:2781] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:41:04.782281 23772 leader_election.cc:302] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:04.785607 23594 raft_consensus.cc:1261] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:41:04.793233 25408 raft_consensus.cc:2781] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:41:04.795267 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a180725c9e34d0095ab423614678d88" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:04.795569 23699 raft_consensus.cc:1226] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 4. Current term is 5. Ops: []
I20260807 13:41:04.796124 23707 raft_consensus.cc:2379] T 7a180725c9e34d0095ab423614678d88 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 1: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:41:04.796557 25419 raft_consensus.cc:686] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:04.797889 25419 consensus_queue.cc:237] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.770798 25000 leader_election.cc:288] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:04.805169 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:04.815076 23591 raft_consensus.cc:2454] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 5.
I20260807 13:41:04.757130 25158 consensus_queue.cc:1035] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260807 13:41:04.817524 23662 leader_election.cc:302] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:04.821794 25503 raft_consensus.cc:2726] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:04.790403 25440 raft_consensus.cc:686] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:04.833518 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:04.786044 23705 raft_consensus.cc:2454] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 5.
W20260807 13:41:04.835105 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 75096.4us
I20260807 13:41:04.803534 25408 raft_consensus.cc:686] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:04.818635 25451 raft_consensus.cc:686] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:04.791204 25452 consensus_queue.cc:1046] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260807 13:41:04.846844 23769 leader_election.cc:302] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:04.793640 25092 consensus_queue.cc:1035] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.043s
I20260807 13:41:04.828904 25494 leader_election.cc:288] T 7a180725c9e34d0095ab423614678d88 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
@ 0x7f4619353da9 testing::TestInfo::Run() at ??:0
I20260807 13:41:04.833092 25455 raft_consensus.cc:2781] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader election won for term 5
W20260807 13:41:04.852917 25518 log.cc:924] Time spent T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.075s user 0.001s sys 0.000s
I20260807 13:41:04.849231 25416 leader_election.cc:288] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:04.807919 25433 consensus_queue.cc:1035] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260807 13:41:04.810225 25070 consensus_queue.cc:1046] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260807 13:41:04.856287 23591 raft_consensus.cc:1261] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 13:41:04.805509 25423 raft_consensus.cc:504] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.859318 23555 leader_election.cc:302] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:04.835270 25532 raft_consensus.cc:2726] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:41:04.872182 23769 leader_election.cc:302] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:04.857252 25452 consensus_queue.cc:1225] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer 8a3af1d071e74f2eb0c821e2bd68fe37 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260807 13:41:04.853101 25408 consensus_queue.cc:237] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:04.866796 25409 leader_election.cc:288] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:04.849896 25454 consensus_queue.cc:1046] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260807 13:41:04.890407 23711 raft_consensus.cc:1226] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 4. Current term is 5. Ops: []
W20260807 13:41:04.891407 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 109136us
I20260807 13:41:04.892041 23769 leader_election.cc:302] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:41:04.842758 25513 consensus_queue.cc:1035] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260807 13:41:04.893388 25443 raft_consensus.cc:482] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:04.875825 25455 raft_consensus.cc:686] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:04.884744 25536 raft_consensus.cc:2726] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260807 13:41:04.971864 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 79936.7us
I20260807 13:41:04.890775 25361 raft_consensus.cc:2781] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:41:04.888783 25503 raft_consensus.cc:2726] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:41:04.977316 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:04.996789 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:04.998751 23597 raft_consensus.cc:2454] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:05.004710 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:05.005168 23813 raft_consensus.cc:1261] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260807 13:41:05.005499 23817 raft_consensus.cc:2362] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4. Re-sending same reply.
I20260807 13:41:05.005694 23813 pending_rounds.cc:76] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697: Aborting all ops after (but not including) 1
I20260807 13:41:05.006062 23813 pending_rounds.cc:97] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260807 13:41:05.006429 23813 raft_consensus.cc:2866] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:41:04.986578 25440 consensus_queue.cc:237] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.006600 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:05.001297 25478 raft_consensus.cc:482] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:05.006906 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:05.011835 25478 raft_consensus.cc:504] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.014958 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:05.008103 25423 leader_election.cc:288] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:05.015604 23818 raft_consensus.cc:2454] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:41:05.015959 25505 raft_consensus.cc:3032] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:41:05.016597 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:05.009080 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:05.017766 23823 raft_consensus.cc:2454] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
I20260807 13:41:05.017953 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:05.018560 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:05.019136 23823 raft_consensus.cc:2362] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4. Re-sending same reply.
I20260807 13:41:05.019958 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:05.020752 23823 raft_consensus.cc:2396] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:41:05.021521 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:05.008503 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:04.887329 25158 consensus_queue.cc:1035] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.090s
I20260807 13:41:05.027190 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:05.028519 23815 raft_consensus.cc:2379] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:41:05.029402 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:05.030686 25449 raft_consensus.cc:3032] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:41:05.031213 25449 raft_consensus.cc:729] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:05.022527 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:05.036054 23823 raft_consensus.cc:2454] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
W20260807 13:41:05.032687 25525 log.cc:924] Time spent T c9552d42b445450691daef21fba4059a P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.193s user 0.000s sys 0.001s
I20260807 13:41:04.898016 25459 leader_election.cc:288] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:05.032035 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:05.016499 25505 raft_consensus.cc:729] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:41:05.043356 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:05.045176 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:05.046150 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:05.055294 23711 raft_consensus.cc:2379] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 4: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:41:05.055624 23600 raft_consensus.cc:2379] T e4d6a524bccf4e4a98f503c584d91cb3 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 4: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:41:05.018479 23818 raft_consensus.cc:2362] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4. Re-sending same reply.
I20260807 13:41:05.051483 23825 raft_consensus.cc:2454] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:41:05.034019 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac6e18ecd14ba2a7d3e846a9fc81bf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:05.053934 23709 raft_consensus.cc:2454] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:41:05.061739 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:05.062897 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:05.068677 23662 leader_election.cc:302] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:04.996025 25452 raft_consensus.cc:2781] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:41:05.072991 23597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:05.067418 23812 raft_consensus.cc:2396] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
W20260807 13:41:05.078989 23535 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:41:05.040618 25478 leader_election.cc:288] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:05.085470 23597 raft_consensus.cc:1226] T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 13:41:04.899199 25443 raft_consensus.cc:504] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.087502 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:05.090591 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:05.083283 25430 raft_consensus.cc:2781] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:41:05.063344 25361 raft_consensus.cc:686] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:41:05.100291 23591 raft_consensus.cc:1226] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:41:05.068308 25269 leader_election.cc:288] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:05.121241 23591 raft_consensus.cc:1226] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:41:05.102432 23595 raft_consensus.cc:1261] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260807 13:41:05.105206 25530 log.cc:924] Time spent T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.108s user 0.000s sys 0.001s
I20260807 13:41:05.109436 25532 raft_consensus.cc:3032] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:41:05.090739 25452 raft_consensus.cc:686] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:05.122087 23555 leader_election.cc:302] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:05.092439 25494 raft_consensus.cc:482] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:04.986626 25451 consensus_queue.cc:237] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.078469 25438 consensus_queue.cc:1046] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260807 13:41:05.154513 23598 raft_consensus.cc:2454] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
W20260807 13:41:05.137028 25476 consensus_meta.cc:287] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.725s user 0.011s sys 0.004s
I20260807 13:41:05.123957 25430 raft_consensus.cc:686] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:05.125370 25532 raft_consensus.cc:729] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:05.172243 25532 consensus_queue.cc:260] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.173585 25532 raft_consensus.cc:3037] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:05.170496 25443 leader_election.cc:288] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:41:05.177798 23660 leader_election.cc:334] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Timed out: RequestConsensusVote RPC to 127.21.82.67:46685 timed out after 2.184s (SENT)
I20260807 13:41:05.178267 23660 leader_election.cc:302] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:05.159642 25092 raft_consensus.cc:3032] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:41:05.181659 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:05.179116 23817 raft_consensus.cc:2454] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 5.
I20260807 13:41:05.200469 23662 leader_election.cc:302] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:05.166317 25070 raft_consensus.cc:2781] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:41:05.207396 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:05.212682 23598 raft_consensus.cc:2454] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:41:05.094862 25449 consensus_queue.cc:260] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:41:05.186429 25475 consensus_meta.cc:287] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.617s user 0.011s sys 0.003s
I20260807 13:41:05.215833 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a180725c9e34d0095ab423614678d88" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:05.097755 25455 consensus_queue.cc:237] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.137868 25494 raft_consensus.cc:504] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.216523 23820 raft_consensus.cc:2454] T 7a180725c9e34d0095ab423614678d88 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 0.
I20260807 13:41:05.221509 23662 leader_election.cc:302] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:05.208739 25443 raft_consensus.cc:2726] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:05.186833 25092 raft_consensus.cc:729] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:05.254396 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:05.255170 23820 raft_consensus.cc:3037] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:05.220089 25417 raft_consensus.cc:2781] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:41:05.120328 25505 consensus_queue.cc:260] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.243335 25158 raft_consensus.cc:2781] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260807 13:41:05.251313 25038 consensus_meta.cc:287] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent flushing consensus metadata: real 0.524s user 0.013s sys 0.002s
I20260807 13:41:05.261942 25449 raft_consensus.cc:3037] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
W20260807 13:41:05.272013 25541 log.cc:924] Time spent T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.094s user 0.001s sys 0.000s
I20260807 13:41:05.273025 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:05.246584 25070 raft_consensus.cc:686] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:41:05.214231 25524 consensus_queue.cc:1035] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260807 13:41:05.214393 25476 consensus_queue.cc:1046] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
W20260807 13:41:05.304040 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 116234us
I20260807 13:41:05.278713 23600 raft_consensus.cc:2396] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:41:05.197301 25361 consensus_queue.cc:237] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.287268 23813 raft_consensus.cc:1226] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Rejecting Update request from peer 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 3. Current term is 4. Ops: []
W20260807 13:41:05.300107 25542 log.cc:924] Time spent T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.187s user 0.005s sys 0.002s
I20260807 13:41:05.301842 25394 raft_consensus.cc:3032] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:41:05.268558 25158 raft_consensus.cc:482] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:41:05.325985 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 103660us
I20260807 13:41:05.275729 25352 raft_consensus.cc:482] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:41:05.245098 25452 consensus_queue.cc:237] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.283596 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:05.285024 25417 raft_consensus.cc:686] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:05.310873 25454 raft_consensus.cc:482] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:05.277509 25443 raft_consensus.cc:482] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:05.394484 23820 raft_consensus.cc:2454] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:41:05.415866 25038 raft_consensus.cc:482] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:41:05.262280 25430 consensus_queue.cc:237] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.419059 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac6e18ecd14ba2a7d3e846a9fc81bf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:05.421980 23820 raft_consensus.cc:2396] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 13:41:05.399137 25158 raft_consensus.cc:3037] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:05.427510 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:05.429420 23600 raft_consensus.cc:1261] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:41:05.390333 25394 raft_consensus.cc:729] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:41:05.305469 25092 consensus_queue.cc:260] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.416431 25494 leader_election.cc:288] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:05.438603 23591 raft_consensus.cc:1261] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260807 13:41:05.418709 25443 raft_consensus.cc:504] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:41:05.440446 25550 log.cc:924] Time spent T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.071s user 0.001s sys 0.000s
I20260807 13:41:05.402220 25352 raft_consensus.cc:504] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:41:05.443254 25546 log.cc:924] Time spent T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.167s user 0.000s sys 0.001s
I20260807 13:41:05.449148 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:05.453594 23709 raft_consensus.cc:2454] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:41:05.421562 25506 raft_consensus.cc:482] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
W20260807 13:41:05.454921 25475 consensus_queue.cc:1159] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "08757cfbeffb41bbab14c2ef00e9d812" responder_term: 4 status { last_received { term: 4 index: 3 } last_committed_idx: 2 last_received_current_leader { term: 4 index: 3 } }
I20260807 13:41:05.455385 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:05.454581 25506 raft_consensus.cc:504] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.456543 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:05.457609 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:05.430541 25269 raft_consensus.cc:482] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:05.459326 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7472ae891a234d26a82a6d485d983386" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:05.459002 25269 raft_consensus.cc:504] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.460430 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:05.438748 23814 raft_consensus.cc:2379] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 3: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:41:05.461736 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:05.416489 25038 raft_consensus.cc:504] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.482815 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a180725c9e34d0095ab423614678d88" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:05.483896 23818 raft_consensus.cc:3037] T 7a180725c9e34d0095ab423614678d88 P d28e736aee9f4f01b013de670a762697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:41:05.408046 25454 raft_consensus.cc:504] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.461367 25092 raft_consensus.cc:3037] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:05.457683 25506 leader_election.cc:288] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:05.499321 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:05.500286 23814 raft_consensus.cc:2454] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:41:05.431833 25070 consensus_queue.cc:237] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.499338 25472 raft_consensus.cc:482] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:41:05.519239 25269 leader_election.cc:288] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:05.534826 25419 raft_consensus.cc:482] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:05.535604 25419 raft_consensus.cc:504] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.546392 23818 raft_consensus.cc:2454] T 7a180725c9e34d0095ab423614678d88 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1.
I20260807 13:41:05.556529 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c1184114b02410098331e68d3b8d4cf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:05.564056 23818 raft_consensus.cc:2454] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
W20260807 13:41:05.562629 25550 log.cc:924] Time spent T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.059s user 0.001s sys 0.000s
W20260807 13:41:05.628674 25495 consensus_meta.cc:287] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent flushing consensus metadata: real 0.891s user 0.012s sys 0.005s
I20260807 13:41:05.637606 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:05.639314 23818 raft_consensus.cc:2454] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:05.568081 25469 raft_consensus.cc:482] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:41:05.494876 25417 consensus_queue.cc:237] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.556587 25472 raft_consensus.cc:504] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.651726 25495 raft_consensus.cc:482] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:05.655200 25354 raft_consensus.cc:482] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:05.660337 25495 raft_consensus.cc:504] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.660562 25354 raft_consensus.cc:504] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.663456 25495 leader_election.cc:288] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:05.663257 25354 leader_election.cc:288] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:05.656834 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:05.665876 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a180725c9e34d0095ab423614678d88" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:05.666927 23818 raft_consensus.cc:2379] T 7a180725c9e34d0095ab423614678d88 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 1: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:41:05.667804 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:05.497206 25394 consensus_queue.cc:260] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.642706 25566 raft_consensus.cc:482] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:05.688977 25472 leader_election.cc:288] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:05.689312 25566 raft_consensus.cc:504] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.691514 25566 leader_election.cc:288] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:05.656068 25469 raft_consensus.cc:504] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.695988 25469 leader_election.cc:288] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:05.687006 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
W20260807 13:41:05.689043 25563 log.cc:924] Time spent T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.181s user 0.001s sys 0.000s
I20260807 13:41:05.697113 23821 raft_consensus.cc:2396] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:41:05.655611 25440 raft_consensus.cc:482] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:05.671547 25419 leader_election.cc:288] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:41:05.681489 25415 consensus_meta.cc:287] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.905s user 0.015s sys 0.000s
W20260807 13:41:05.705755 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 227260us
I20260807 13:41:05.709008 23555 leader_election.cc:302] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:05.731102 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:05.736893 25451 raft_consensus.cc:482] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:05.737401 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:05.737617 25451 raft_consensus.cc:504] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } }
I20260807 13:41:05.738060 23709 raft_consensus.cc:2454] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:41:05.741420 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:05.741671 25451 leader_election.cc:288] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187)
I20260807 13:41:05.742379 23699 raft_consensus.cc:2454] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:41:05.744663 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:05.745788 23703 raft_consensus.cc:2379] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 4: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:41:05.746174 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:05.747220 23705 raft_consensus.cc:2454] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 5.
I20260807 13:41:05.747360 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:05.748183 23704 raft_consensus.cc:2454] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 3.
I20260807 13:41:05.749163 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:05.749624 23555 leader_election.cc:302] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:05.749812 23601 raft_consensus.cc:2454] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 5.
I20260807 13:41:05.750450 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:05.749672 23600 raft_consensus.cc:1261] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260807 13:41:05.727720 25433 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s user 0.075s sys 0.130s
I20260807 13:41:05.761582 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:05.729245 25280 raft_consensus.cc:482] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:05.765529 23703 raft_consensus.cc:2454] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:41:05.755374 25472 raft_consensus.cc:2781] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260807 13:41:05.762763 25433 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s user 0.076s sys 0.130s
W20260807 13:41:05.776276 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 346608us
I20260807 13:41:05.756151 25062 raft_consensus.cc:482] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:05.706152 25440 raft_consensus.cc:504] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.710453 25415 raft_consensus.cc:504] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.772249 25469 raft_consensus.cc:2781] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:05.768287 25038 leader_election.cc:288] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:05.795073 25540 raft_consensus.cc:482] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:05.795885 25540 raft_consensus.cc:504] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.784588 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:05.784498 25443 leader_election.cc:288] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:05.800117 23812 raft_consensus.cc:2454] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:05.801352 25158 raft_consensus.cc:504] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.794144 25469 raft_consensus.cc:482] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:05.803313 25469 raft_consensus.cc:3037] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:05.805402 25158 leader_election.cc:288] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:05.777163 25454 leader_election.cc:288] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:05.809644 25446 raft_consensus.cc:3032] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:41:05.811431 23821 raft_consensus.cc:1226] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 13:41:05.812842 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a180725c9e34d0095ab423614678d88" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:05.813678 23821 raft_consensus.cc:2379] T 7a180725c9e34d0095ab423614678d88 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 1: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:41:05.782059 25472 raft_consensus.cc:482] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:05.810395 25446 raft_consensus.cc:729] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:05.838445 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:05.848977 23821 raft_consensus.cc:3037] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:05.781448 25280 raft_consensus.cc:504] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:05.786481 25062 raft_consensus.cc:504] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:41:05.850514 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 86247.1us
I20260807 13:41:05.993805 23821 raft_consensus.cc:2454] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 5.
W20260807 13:41:05.887709 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 93400.7us
I20260807 13:41:05.830785 25472 raft_consensus.cc:3037] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:06.074311 23555 leader_election.cc:302] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:06.076386 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "830e8cb8ce434e6391c09530c677a61d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:05.828222 25513 raft_consensus.cc:482] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:05.828723 25419 raft_consensus.cc:482] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:41:06.077720 23554 leader_election.cc:334] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Timed out: RequestConsensusVote RPC to 127.21.82.67:46685 timed out after 2.053s (SENT)
W20260807 13:41:05.838869 25553 log.cc:924] Time spent T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.352s user 0.000s sys 0.001s
I20260807 13:41:05.830087 25454 raft_consensus.cc:482] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:06.099898 23555 leader_election.cc:302] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
W20260807 13:41:05.936245 25532 consensus_meta.cc:287] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.749s user 0.012s sys 0.004s
W20260807 13:41:06.096079 25449 consensus_meta.cc:287] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.816s user 0.011s sys 0.004s
I20260807 13:41:06.047750 25038 raft_consensus.cc:482] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:05.964691 25540 leader_election.cc:288] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:06.036043 25451 raft_consensus.cc:482] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:05.893569 23812 raft_consensus.cc:1261] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 1. (term mismatch)
I20260807 13:41:05.896991 25566 raft_consensus.cc:482] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:05.934779 25443 raft_consensus.cc:482] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:06.096784 23817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 505) took 1114 ms. Trace:
I20260807 13:41:06.050568 25440 leader_election.cc:288] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:06.106988 23818 raft_consensus.cc:2396] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:41:06.085322 25388 raft_consensus.cc:2781] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:05.896908 25158 consensus_queue.cc:1035] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.211s
I20260807 13:41:06.109750 23555 leader_election.cc:302] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:06.118290 23555 leader_election.cc:302] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:06.110745 23812 pending_rounds.cc:76] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697: Aborting all ops after (but not including) 0
I20260807 13:41:06.104668 25454 raft_consensus.cc:504] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:06.120934 23821 raft_consensus.cc:2454] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:41:06.177918 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:06.178777 23821 raft_consensus.cc:2454] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:05.963774 25446 consensus_queue.cc:260] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:06.109184 25415 leader_election.cc:288] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:06.113838 25506 raft_consensus.cc:2781] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:06.110882 25449 raft_consensus.cc:482] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:06.119037 25388 raft_consensus.cc:482] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:06.084863 25419 raft_consensus.cc:504] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:06.183194 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:06.210254 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:06.217645 23821 raft_consensus.cc:3037] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:06.213361 23595 raft_consensus.cc:1261] T a8d8d3a6cd704602b71ac7d5122cf9cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:41:06.176251 25495 raft_consensus.cc:2781] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:41:06.176258 23812 pending_rounds.cc:97] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260807 13:41:06.216199 23711 raft_consensus.cc:1261] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260807 13:41:06.181986 25445 log.cc:924] Time spent T 00000000000000000000000000000000 P 8d9f7da4966a48d19a772a0a16fcf6da: Append to log took a long time: real 0.065s user 0.000s sys 0.000s
I20260807 13:41:06.228202 25573 raft_consensus.cc:482] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:06.109937 25038 raft_consensus.cc:504] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:41:06.218973 23554 leader_election.cc:334] T cf2e5e45fca749498a80852c430edb21 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Timed out: RequestConsensusVote RPC to 127.21.82.67:46685 timed out after 2.192s (SENT)
I20260807 13:41:06.217191 23598 raft_consensus.cc:2454] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 5.
I20260807 13:41:06.112612 25451 raft_consensus.cc:504] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:06.280699 25451 leader_election.cc:288] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:06.228515 25280 leader_election.cc:288] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:06.095204 25513 raft_consensus.cc:504] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:06.115098 25566 raft_consensus.cc:504] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
@ 0x7f4619354d85 testing::TestSuite::Run() at ??:0
I20260807 13:41:06.184132 25540 raft_consensus.cc:482] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:06.218501 25388 raft_consensus.cc:3037] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:06.239511 23699 raft_consensus.cc:1261] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:41:06.247594 25419 leader_election.cc:288] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:06.115499 25443 raft_consensus.cc:504] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:06.218206 25449 raft_consensus.cc:504] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:41:06.277392 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 58451.9us
I20260807 13:41:06.112478 23817 rpcz_store.cc:276] 0807 13:41:04.982947 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:05.006299 (+ 23352us) service_pool.cc:227] Handling call
0807 13:41:06.096527 (+1090228us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54000affd4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:41:06.096684 (+ 157us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":376048896}
I20260807 13:41:06.186530 25560 raft_consensus.cc:2781] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:41:06.222025 25495 raft_consensus.cc:482] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:41:06.212801 25446 raft_consensus.cc:3037] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:06.210465 25506 raft_consensus.cc:482] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:41:06.318775 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:06.334506 23594 raft_consensus.cc:2454] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:06.250041 23590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 711) took 1207 ms. Trace:
I20260807 13:41:06.335937 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:06.337810 23594 raft_consensus.cc:1226] T 214fb4bbf05e4280a55113485d8ce2f5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:41:06.335559 23590 rpcz_store.cc:276] 0807 13:41:05.042308 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:05.047285 (+ 4977us) service_pool.cc:227] Handling call
0807 13:41:05.112178 (+ 64893us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b5800001898. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f46210032b0 00007f4620fee7f9 00007f4620fee2a2 00007f461a6d4684
0807 13:41:05.112530 (+ 352us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:41:05.169441 (+ 56911us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:41:05.169493 (+ 52us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:41:05.170030 (+ 537us) log.cc:842] Serialized 26 byte log entry
0807 13:41:05.269928 (+ 99898us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:41:05.270058 (+ 130us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:05.270184 (+ 126us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:41:05.813282 (+543098us) spinlock_profiling.cc:243] Waited 5.28 ms on lock 0x7b44000232cc. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f4619097a95 00007f46190984b2 00007f461bd40511 00007f461bd3be1a 00007f461bd2fbee 00007f461bd2ef36 00007f461bd2eb58 00007f461bd38551 00007f461bd38509 00007f461bd38499
0807 13:41:06.213244 (+399962us) raft_consensus.cc:1671] finished
0807 13:41:06.215856 (+ 2612us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:41:06.236200 (+ 20344us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":70374,"raft.queue_time_us":54257,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":2053,"spinlock_wait_cycles":17512064,"thread_start_us":93560,"threads_started":1,"wal-append.queue_time_us":232822}
I20260807 13:41:06.280967 25454 leader_election.cc:288] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:06.321422 23821 raft_consensus.cc:2454] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 5.
I20260807 13:41:06.339582 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:06.230104 23812 raft_consensus.cc:2866] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:41:06.340553 23812 pending_rounds.cc:97] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260807 13:41:06.340925 23812 raft_consensus.cc:2866] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:41:06.320494 25540 raft_consensus.cc:504] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:06.312386 23772 leader_election.cc:302] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:06.343912 25597 raft_consensus.cc:2781] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:41:06.328389 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:06.344599 25597 raft_consensus.cc:482] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:06.345082 23705 raft_consensus.cc:2454] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:41:06.345481 25597 raft_consensus.cc:3037] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:41:06.347205 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:06.347548 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:06.348495 25505 raft_consensus.cc:3037] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:06.348851 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:06.355430 25599 raft_consensus.cc:482] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:06.356228 25599 raft_consensus.cc:504] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:06.357609 25566 leader_election.cc:288] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:06.276747 25038 leader_election.cc:288] T 7c1184114b02410098331e68d3b8d4cf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:41:06.284045 25581 log.cc:924] Time spent T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.303s user 0.000s sys 0.002s
I20260807 13:41:06.360859 25513 leader_election.cc:288] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:41:06.357060 25565 log.cc:924] Time spent T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.830s user 0.003s sys 0.000s
I20260807 13:41:06.284861 23813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45370 (request call id 526) took 1100 ms. Trace:
I20260807 13:41:06.286959 25573 raft_consensus.cc:504] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:06.360229 25599 leader_election.cc:288] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:06.362866 23813 rpcz_store.cc:276] 0807 13:41:05.184296 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:05.430417 (+246121us) service_pool.cc:227] Handling call
0807 13:41:05.478539 (+ 48122us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:41:05.531084 (+ 52545us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:41:05.561717 (+ 30633us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:41:05.703981 (+142264us) log.cc:842] Serialized 52 byte log entry
0807 13:41:06.048204 (+344223us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:41:06.065134 (+ 16930us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:06.075398 (+ 10264us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:41:06.284376 (+208978us) raft_consensus.cc:1671] finished
0807 13:41:06.284416 (+ 40us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:41:06.284735 (+ 319us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":17501,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":117,"thread_start_us":116903,"threads_started":1,"wal-append.queue_time_us":462100}
I20260807 13:41:06.331278 25158 raft_consensus.cc:482] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:06.367416 25062 leader_election.cc:288] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:06.367692 25158 raft_consensus.cc:504] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:06.369266 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:06.373211 25443 leader_election.cc:288] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:41:06.375355 25574 log.cc:924] Time spent T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.635s user 0.002s sys 0.007s
I20260807 13:41:06.376544 25449 leader_election.cc:288] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:06.325907 23814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45370 (request call id 528) took 1141 ms. Trace:
I20260807 13:41:06.334075 25495 raft_consensus.cc:3037] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:06.379335 23814 rpcz_store.cc:276] 0807 13:41:05.184868 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:05.501218 (+316350us) service_pool.cc:227] Handling call
0807 13:41:05.501635 (+ 417us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:41:05.588507 (+ 86872us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:41:05.595906 (+ 7399us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:41:05.728843 (+132937us) log.cc:842] Serialized 26 byte log entry
0807 13:41:06.064877 (+336034us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:41:06.076896 (+ 12019us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:06.081888 (+ 4992us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:41:06.296387 (+214499us) raft_consensus.cc:1671] finished
0807 13:41:06.307949 (+ 11562us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:41:06.323056 (+ 15107us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":18497,"raft.queue_time_us":38853,"raft.run_cpu_time_us":357,"raft.run_wall_time_us":18053,"thread_start_us":177474,"threads_started":1,"wal-append.queue_time_us":471023}
I20260807 13:41:06.326803 25560 raft_consensus.cc:482] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
W20260807 13:41:06.330111 25092 consensus_meta.cc:287] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.832s user 0.005s sys 0.009s
I20260807 13:41:06.286075 25584 raft_consensus.cc:482] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:06.366143 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:41:06.386233 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 310372us
W20260807 13:41:06.373238 25577 log.cc:924] Time spent T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.636s user 0.003s sys 0.005s
I20260807 13:41:06.412194 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6df7e3fe3a74e6d818aeb532b42d6ba" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:41:06.437125 23554 leader_election.cc:334] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685): Timed out: RequestConsensusVote RPC to 127.21.82.67:46685 timed out after 2.331s (SENT)
I20260807 13:41:06.362047 25513 consensus_queue.cc:1035] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260807 13:41:06.348776 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:41:06.423394 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 79852us
I20260807 13:41:06.413983 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:06.398481 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:06.449427 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:06.383031 25506 raft_consensus.cc:3037] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:06.438707 23709 raft_consensus.cc:1226] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:06.439364 23554 leader_election.cc:302] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:41:06.446702 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2f67b0d087a474ea05fb3c7ceb2f5ae" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:06.447527 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:41:06.455191 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 203755us
I20260807 13:41:06.365940 25573 leader_election.cc:288] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:06.461861 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "910844a7b519444faad288ab2098a066" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:06.462642 23818 raft_consensus.cc:3037] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:06.465325 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:06.466383 23823 raft_consensus.cc:2379] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 5: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:41:06.411777 25454 raft_consensus.cc:482] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:06.493396 23700 raft_consensus.cc:1226] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 3. Ops: []
I20260807 13:41:06.493485 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:06.495419 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:06.386346 25560 raft_consensus.cc:3037] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:06.350603 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:06.437913 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:06.458110 25158 leader_election.cc:288] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:06.435247 25584 raft_consensus.cc:504] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:06.511451 23814 raft_consensus.cc:3037] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:06.511694 25449 raft_consensus.cc:482] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:06.512652 25449 raft_consensus.cc:504] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:06.513962 25584 leader_election.cc:288] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:06.510064 23707 raft_consensus.cc:1226] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 LEADER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:41:06.501595 25454 raft_consensus.cc:504] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:06.515916 23817 raft_consensus.cc:2454] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 5.
I20260807 13:41:06.516868 25454 leader_election.cc:288] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:06.517283 23595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:06.517729 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:06.518209 23555 leader_election.cc:302] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:06.490442 25062 raft_consensus.cc:2726] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:41:06.519567 24739 consensus_queue.cc:1035] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:41:06.521435 24739 raft_consensus.cc:2781] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:06.521792 24739 raft_consensus.cc:482] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:06.522274 24739 raft_consensus.cc:3037] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:06.523108 23662 leader_election.cc:302] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:06.524677 23662 leader_election.cc:302] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:06.526062 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:06.527526 23817 raft_consensus.cc:2454] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
W20260807 13:41:06.529446 25568 log.cc:924] Time spent T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 1.006s user 0.001s sys 0.007s
I20260807 13:41:06.498152 25038 consensus_queue.cc:1035] T bd314efc5fa240fe8e411f52346a18f1 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260807 13:41:06.532758 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:06.526463 25449 leader_election.cc:288] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:06.536249 25566 raft_consensus.cc:2781] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:41:06.536679 25394 raft_consensus.cc:3037] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:06.537034 25566 raft_consensus.cc:482] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:06.457083 25443 raft_consensus.cc:482] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:06.539047 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:41:06.510478 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 73388.9us
W20260807 13:41:06.540724 23660 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.580s user 0.009s sys 0.025s
I20260807 13:41:06.543473 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
W20260807 13:41:06.547675 23660 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.587s user 0.009s sys 0.025s
I20260807 13:41:06.548403 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:06.551214 23600 raft_consensus.cc:3037] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:41:06.549948 23554 leader_election.cc:302] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:41:06.553431 23818 raft_consensus.cc:2454] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 5.
I20260807 13:41:06.554912 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:06.555658 23700 raft_consensus.cc:2454] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 4.
I20260807 13:41:06.554944 23554 leader_election.cc:302] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:06.555673 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c1184114b02410098331e68d3b8d4cf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:06.561925 23818 raft_consensus.cc:2454] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 2.
W20260807 13:41:06.502339 25570 log.cc:924] Time spent T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.563s user 0.007s sys 0.000s
I20260807 13:41:06.563143 23588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 713) took 1518 ms. Trace:
I20260807 13:41:06.575519 23588 rpcz_store.cc:276] 0807 13:41:05.044335 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:05.051119 (+ 6784us) service_pool.cc:227] Handling call
0807 13:41:05.113759 (+ 62640us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:41:05.167808 (+ 54049us) raft_consensus.cc:1520] Early marking committed up to index 1
0807 13:41:05.175365 (+ 7557us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:41:05.274266 (+ 98901us) log.cc:842] Serialized 52 byte log entry
0807 13:41:05.503485 (+229219us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:41:05.504468 (+ 983us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:05.519899 (+ 15431us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:41:06.527732 (+1007833us) spinlock_profiling.cc:243] Waited 8.33 ms on lock 0x7b44000232cc. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f4619097a95 00007f46190984b2 00007f461bd40511 00007f461bd3be1a 00007f461bd2fbee 00007f461bd2ef36 00007f461bd2eb58 00007f461bd38551 00007f461bd38509 00007f461bd38499
0807 13:41:06.550625 (+ 22893us) raft_consensus.cc:1671] finished
0807 13:41:06.550696 (+ 71us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:41:06.563006 (+ 12310us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":23228,"raft.queue_time_us":49153,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":10172,"spinlock_wait_cycles":19162880,"thread_start_us":76504,"threads_started":1,"wal-append.queue_time_us":194352}
I20260807 13:41:06.534241 25352 leader_election.cc:288] T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:06.490412 25595 consensus_queue.cc:1035] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.119s
I20260807 13:41:06.563413 23590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2c88606c274605948654e7a33c9982" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:06.580180 23590 raft_consensus.cc:3037] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:06.581936 25408 raft_consensus.cc:482] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:06.557472 25280 raft_consensus.cc:2726] T 31124698024d476f89cdf788d21e50b7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:41:06.564169 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:06.582939 25408 raft_consensus.cc:504] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:06.584348 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:06.585244 23820 raft_consensus.cc:2379] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 4: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:41:06.586423 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:06.565310 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:06.588819 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:06.589666 23823 raft_consensus.cc:2454] T 72d879feba30417e9919fc152b543506 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:41:06.591300 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:06.592116 23823 raft_consensus.cc:2362] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 5. Re-sending same reply.
I20260807 13:41:06.593146 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:06.595244 23823 raft_consensus.cc:2454] T fd31593673b040a184ccd6160a9674de P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:41:06.596438 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a180725c9e34d0095ab423614678d88" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:06.567564 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:06.566491 25584 consensus_queue.cc:1035] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:41:06.547009 25566 raft_consensus.cc:3037] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:41:06.605334 23825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45370 (request call id 527) took 1410 ms. Trace:
I20260807 13:41:06.603012 23823 raft_consensus.cc:2362] T 7a180725c9e34d0095ab423614678d88 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 1. Re-sending same reply.
I20260807 13:41:06.609547 23825 rpcz_store.cc:276] 0807 13:41:05.184580 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:05.445039 (+260459us) service_pool.cc:227] Handling call
0807 13:41:05.666635 (+221596us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b5800255098. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f46210032b0 00007f4620fee7f9 00007f4620fee2a2 00007f461a6d4684
0807 13:41:05.666924 (+ 289us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:41:05.667341 (+ 417us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:41:05.667378 (+ 37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:41:05.667938 (+ 560us) log.cc:842] Serialized 26 byte log entry
0807 13:41:05.711353 (+ 43415us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:41:05.711433 (+ 80us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:05.711530 (+ 97us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:41:06.371457 (+659927us) spinlock_profiling.cc:243] Waited 91.4 ms on lock 0x7b44000232cc. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f4619097a95 00007f46190984b2 00007f461bd40511 00007f461bd3be1a 00007f461bd2fbee 00007f461bd2ef36 00007f461bd2eb58 00007f461bd38551 00007f461bd38509 00007f461bd38499
0807 13:41:06.594573 (+223116us) raft_consensus.cc:1671] finished
0807 13:41:06.594603 (+ 30us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:41:06.594775 (+ 172us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":10916,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":4208,"spinlock_wait_cycles":213000960,"thread_start_us":42925,"threads_started":1,"wal-append.queue_time_us":68477}
I20260807 13:41:06.589179 25409 raft_consensus.cc:2781] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260807 13:41:06.607738 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 52933.4us
I20260807 13:41:06.611558 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac6e18ecd14ba2a7d3e846a9fc81bf" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:06.612069 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c1184114b02410098331e68d3b8d4cf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:06.509056 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:06.613474 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:06.615797 23600 raft_consensus.cc:2454] T 620e30fb1ff34164a7a4f66804acc719 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:41:06.499806 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:06.621759 23820 raft_consensus.cc:2454] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:41:06.624653 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
W20260807 13:41:06.606980 25361 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.780s user 0.016s sys 0.028s
I20260807 13:41:06.631134 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:06.633025 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:06.633559 23823 raft_consensus.cc:2362] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4. Re-sending same reply.
I20260807 13:41:06.633805 23591 raft_consensus.cc:1261] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:41:06.634142 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:06.635603 23600 raft_consensus.cc:2454] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:41:06.636580 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:06.637166 25604 raft_consensus.cc:482] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:41:06.639190 25579 log.cc:924] Time spent T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.901s user 0.000s sys 0.015s
I20260807 13:41:06.639886 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:06.655766 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9552d42b445450691daef21fba4059a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:06.626289 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:06.658694 23707 raft_consensus.cc:2379] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 4: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:41:06.658829 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:06.659597 23820 raft_consensus.cc:2454] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:06.655418 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:41:06.625445 25472 consensus_meta.cc:287] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812: Time spent flushing consensus metadata: real 0.541s user 0.012s sys 0.003s
I20260807 13:41:06.657505 23825 raft_consensus.cc:3037] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:41:06.620380 25409 raft_consensus.cc:482] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:06.559047 25443 raft_consensus.cc:504] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:41:06.632949 25361 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.840s user 0.017s sys 0.028s
I20260807 13:41:06.559469 25573 consensus_queue.cc:1035] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260807 13:41:06.668272 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:06.670387 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:06.671504 23591 raft_consensus.cc:2396] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:41:06.674232 25560 raft_consensus.cc:504] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:06.675668 23594 raft_consensus.cc:1226] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:06.676883 23597 raft_consensus.cc:1226] T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 LEADER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 13:41:06.653949 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:06.666685 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:06.679939 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:06.680568 23598 raft_consensus.cc:2454] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:41:06.660915 25571 raft_consensus.cc:2781] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:06.682971 23707 raft_consensus.cc:1261] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:41:06.686210 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:06.651001 25524 raft_consensus.cc:482] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:06.670181 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daaea1dffb5443f4858c40ca25e7830e" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:06.634682 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8624086fc56b47cf914a4540b2ba3ae1" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:06.661245 25092 raft_consensus.cc:482] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:06.686136 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:06.688090 23818 raft_consensus.cc:2454] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
I20260807 13:41:06.710837 23772 leader_election.cc:302] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:06.691001 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ce2c21a0a4a6cb65aaf5e0bfe8eac" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:06.713856 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:06.713945 23591 raft_consensus.cc:2454] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:06.714725 23818 raft_consensus.cc:2454] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:06.699492 23825 raft_consensus.cc:2454] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:41:06.716472 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa5fcc43292246d486ebba83eac423d6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:06.666724 25409 raft_consensus.cc:3037] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:06.689990 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:06.716562 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:06.720153 23707 raft_consensus.cc:2379] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 5: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:41:06.721781 23823 raft_consensus.cc:2396] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260807 13:41:06.723735 23825 raft_consensus.cc:1261] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 13:41:06.669090 25472 raft_consensus.cc:504] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:06.743109 23598 raft_consensus.cc:1261] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:41:06.681057 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:06.748073 23662 leader_election.cc:302] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:06.752257 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:06.753137 23598 raft_consensus.cc:2454] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 5.
I20260807 13:41:06.720528 25280 raft_consensus.cc:482] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:41:06.719451 25454 raft_consensus.cc:2781] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:06.755937 23820 raft_consensus.cc:1261] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260807 13:41:06.745759 25469 consensus_meta.cc:287] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent flushing consensus metadata: real 0.942s user 0.015s sys 0.002s
I20260807 13:41:06.762936 23662 leader_election.cc:302] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:06.741775 25599 raft_consensus.cc:482] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:06.729938 25418 raft_consensus.cc:482] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:06.768718 23700 raft_consensus.cc:1226] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:41:06.768626 23662 leader_election.cc:302] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:06.769501 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:06.772835 23711 raft_consensus.cc:2454] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 5.
I20260807 13:41:06.748397 23588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:06.660741 25604 raft_consensus.cc:504] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:06.781590 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac6e18ecd14ba2a7d3e846a9fc81bf" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:06.783128 23820 raft_consensus.cc:3032] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:41:06.783612 23820 raft_consensus.cc:729] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
W20260807 13:41:06.785171 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 203563us
I20260807 13:41:06.791329 23703 raft_consensus.cc:1261] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:41:06.762311 25454 raft_consensus.cc:482] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:06.721217 25092 raft_consensus.cc:504] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:06.762449 23815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45370 (request call id 524) took 1576 ms. Trace:
I20260807 13:41:06.784531 23820 consensus_queue.cc:260] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:06.817039 23820 raft_consensus.cc:3037] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:41:06.818218 23660 leader_election.cc:302] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:06.768113 25594 raft_consensus.cc:2781] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:06.771378 25408 leader_election.cc:288] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:06.758430 25603 raft_consensus.cc:2781] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:41:06.695518 25524 raft_consensus.cc:504] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:06.823925 23662 leader_election.cc:302] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:06.760520 23817 raft_consensus.cc:2362] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3. Re-sending same reply.
I20260807 13:41:06.767941 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:06.824735 25419 raft_consensus.cc:482] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:06.770174 25469 raft_consensus.cc:504] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:06.826962 23660 leader_election.cc:302] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:41:06.779881 25560 leader_election.cc:288] T a47d160dba334fd0a32cff0cfc2459c1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:06.834967 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7985ff913681417583d257589c2e4020" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:06.836479 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:06.818213 25454 raft_consensus.cc:3037] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:06.766083 25280 raft_consensus.cc:504] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:06.761965 25455 consensus_queue.cc:1035] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260807 13:41:06.825212 25594 raft_consensus.cc:482] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:06.827679 25430 raft_consensus.cc:2781] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:06.842897 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9552d42b445450691daef21fba4059a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:06.780668 25418 raft_consensus.cc:504] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:06.777554 25599 raft_consensus.cc:504] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:06.852334 23601 raft_consensus.cc:2379] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 5: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:41:06.830341 25000 raft_consensus.cc:2726] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:41:06.834203 25451 raft_consensus.cc:482] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:06.843820 23812 raft_consensus.cc:1261] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:41:06.851001 25595 raft_consensus.cc:2781] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:41:06.833071 25419 raft_consensus.cc:504] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:06.834465 25573 consensus_queue.cc:1035] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
I20260807 13:41:06.883728 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:06.855211 25594 raft_consensus.cc:3037] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:06.854600 25430 raft_consensus.cc:482] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:06.858783 25503 raft_consensus.cc:482] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
W20260807 13:41:06.880115 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 217482us
I20260807 13:41:06.896128 23769 leader_election.cc:302] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:06.901469 23820 raft_consensus.cc:1261] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260807 13:41:06.909000 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 82108.9us
I20260807 13:41:06.912299 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:06.918952 23599 raft_consensus.cc:2454] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:06.878710 25443 leader_election.cc:288] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:41:06.902133 25608 log.cc:924] Time spent T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.139s user 0.001s sys 0.000s
I20260807 13:41:06.881076 25476 raft_consensus.cc:482] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:06.902983 25573 consensus_queue.cc:1225] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer 08757cfbeffb41bbab14c2ef00e9d812 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260807 13:41:06.928094 23703 raft_consensus.cc:1261] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:41:06.914538 25430 raft_consensus.cc:3037] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:06.886766 25000 raft_consensus.cc:2781] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:41:06.884940 25595 raft_consensus.cc:482] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:06.936142 23599 raft_consensus.cc:1261] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:41:06.902644 25038 raft_consensus.cc:482] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:06.931133 23588 raft_consensus.cc:2396] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260807 13:41:06.892735 23705 raft_consensus.cc:2454] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
W20260807 13:41:06.969645 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 48139.2us
I20260807 13:41:06.939577 23704 raft_consensus.cc:1226] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 LEADER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 4. Current term is 5. Ops: []
I20260807 13:41:06.978195 23599 raft_consensus.cc:1261] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:41:06.978247 23660 leader_election.cc:302] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:06.924527 25503 raft_consensus.cc:504] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:06.888907 25451 raft_consensus.cc:504] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:06.980621 23662 leader_election.cc:302] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
W20260807 13:41:06.981202 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 65608.2us
I20260807 13:41:06.931989 25449 raft_consensus.cc:482] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:06.985914 23554 leader_election.cc:302] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:41:06.931983 25625 raft_consensus.cc:482] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:06.928038 25472 leader_election.cc:288] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:06.968061 25595 raft_consensus.cc:3037] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:41:06.976744 23817 raft_consensus.cc:1261] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260807 13:41:07.003242 23817 pending_rounds.cc:76] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697: Aborting all ops after (but not including) 1
I20260807 13:41:07.003597 23817 pending_rounds.cc:97] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260807 13:41:07.003904 23817 raft_consensus.cc:2866] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:41:06.974248 25455 raft_consensus.cc:482] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
W20260807 13:41:07.011348 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 81958us
I20260807 13:41:07.015175 23769 leader_election.cc:302] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:07.018021 23817 raft_consensus.cc:1261] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:41:06.999434 25449 raft_consensus.cc:504] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.024367 23660 leader_election.cc:302] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:07.025800 25449 leader_election.cc:288] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:06.989387 25621 raft_consensus.cc:482] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:06.970384 25476 raft_consensus.cc:504] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:06.976727 25038 raft_consensus.cc:504] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.010996 23699 raft_consensus.cc:1226] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 LEADER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:07.009876 24905 raft_consensus.cc:2726] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:41:06.998304 25000 raft_consensus.cc:686] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:06.992657 25603 raft_consensus.cc:686] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:07.030305 23769 leader_election.cc:302] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:07.056433 23597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 758) took 2010 ms. Trace:
I20260807 13:41:07.058293 23823 raft_consensus.cc:1261] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:41:07.030712 23660 leader_election.cc:302] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:07.070554 23817 raft_consensus.cc:1261] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Refusing update from remote peer 08757cfbeffb41bbab14c2ef00e9d812: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:41:07.009641 25629 raft_consensus.cc:482] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:07.197342 23823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45360 (request call id 724) took 1008 ms. Trace:
I20260807 13:41:07.196120 23597 rpcz_store.cc:276] 0807 13:41:05.045739 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:05.086432 (+ 40693us) service_pool.cc:227] Handling call
0807 13:41:05.086796 (+ 364us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:41:06.677639 (+1590843us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:07.056115 (+378476us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b540024b154. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:41:07.056355 (+ 240us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3656119552}
I20260807 13:41:06.816725 23815 rpcz_store.cc:276] 0807 13:41:05.183748 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:05.296876 (+113128us) service_pool.cc:227] Handling call
0807 13:41:05.297280 (+ 404us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:41:05.390066 (+ 92786us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:41:05.398150 (+ 8084us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:41:05.415286 (+ 17136us) log.cc:842] Serialized 26 byte log entry
0807 13:41:05.695039 (+279753us) spinlock_profiling.cc:243] Waited 9.12 ms on lock 0x7b18000c4d80. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f46220248b1 00007f4622031661 00007f4619167345 00007f4621f9ea39 00007f46191848bb 00007f4619182cbf 00007f4619184e22 00007f461bd2e5bb 00007f461bd34063 00007f461bd34411 00007f461c0815cf
0807 13:41:05.761059 (+ 66020us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:41:05.764640 (+ 3581us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:05.775851 (+ 11211us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:41:06.637464 (+861613us) spinlock_profiling.cc:243] Waited 89.9 ms on lock 0x7b44000232cc. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f4619097a95 00007f46190984b2 00007f461bd40511 00007f461bd3be1a 00007f461bd2fbee 00007f461bd2ef36 00007f461bd2eb58 00007f461bd38551 00007f461bd38509 00007f461bd38499
0807 13:41:06.745512 (+108048us) raft_consensus.cc:1671] finished
0807 13:41:06.745538 (+ 26us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:41:06.760131 (+ 14593us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":15516,"raft.queue_time_us":101180,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":6391,"spinlock_wait_cycles":227852544,"thread_start_us":58214,"threads_started":1,"wal-append.queue_time_us":321857}
I20260807 13:41:07.022908 25158 raft_consensus.cc:2781] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:41:07.220106 25158 raft_consensus.cc:482] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:07.197717 23823 rpcz_store.cc:276] 0807 13:41:06.188689 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:07.057384 (+868695us) service_pool.cc:227] Handling call
0807 13:41:07.057828 (+ 444us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:41:07.197040 (+139212us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:07.197282 (+ 242us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:41:07.022300 23812 raft_consensus.cc:3032] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Stepping down as leader of term 4
W20260807 13:41:07.038813 25624 log.cc:924] Time spent T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.101s user 0.001s sys 0.000s
I20260807 13:41:07.021432 25092 leader_election.cc:288] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:41:07.230086 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 200999us
I20260807 13:41:07.235685 23823 raft_consensus.cc:3032] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:41:07.236238 23823 raft_consensus.cc:729] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:07.236343 23660 leader_election.cc:302] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
W20260807 13:41:07.036582 24739 consensus_meta.cc:287] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent flushing consensus metadata: real 0.507s user 0.005s sys 0.009s
W20260807 13:41:07.060294 25394 consensus_meta.cc:287] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent flushing consensus metadata: real 0.523s user 0.011s sys 0.007s
I20260807 13:41:07.048775 25408 raft_consensus.cc:2726] T 2133139b13ce49de9c5a382720699163 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 13:41:07.097831 25553 log.cc:924] Time spent T 79f871ca72ef417aa877002c8166b44c P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.084s user 0.000s sys 0.000s
I20260807 13:41:07.091671 25513 raft_consensus.cc:482] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:07.011626 25625 raft_consensus.cc:504] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:41:07.247164 25605 log.cc:924] Time spent T 7472ae891a234d26a82a6d485d983386 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.282s user 0.002s sys 0.000s
I20260807 13:41:07.248706 25573 raft_consensus.cc:482] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:07.037313 25418 leader_election.cc:288] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:07.250562 25419 leader_election.cc:288] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:07.054306 25540 leader_election.cc:288] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:07.239373 23823 consensus_queue.cc:260] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:41:07.253988 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 223783us
I20260807 13:41:07.059577 25469 leader_election.cc:288] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:41:07.258445 23590 consensus_meta.cc:287] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent flushing consensus metadata: real 0.677s user 0.015s sys 0.000s
I20260807 13:41:07.260571 23590 raft_consensus.cc:2454] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:07.010429 25604 leader_election.cc:288] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:41:07.041953 25505 consensus_meta.cc:287] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent flushing consensus metadata: real 0.693s user 0.016s sys 0.003s
I20260807 13:41:07.251505 25443 raft_consensus.cc:2726] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 13:41:07.269709 23769 leader_election.cc:302] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:07.272112 23823 raft_consensus.cc:3037] T 7472ae891a234d26a82a6d485d983386 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:07.246331 25625 leader_election.cc:288] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:07.235116 25158 raft_consensus.cc:3037] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:41:07.272511 23660 leader_election.cc:302] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:07.223729 25524 leader_election.cc:288] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:41:07.253947 25446 consensus_meta.cc:287] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.883s user 0.013s sys 0.002s
I20260807 13:41:07.275550 23769 leader_election.cc:302] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:07.237403 25354 raft_consensus.cc:482] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:41:07.258445 25388 consensus_meta.cc:287] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812: Time spent flushing consensus metadata: real 0.935s user 0.014s sys 0.001s
I20260807 13:41:07.231067 23812 raft_consensus.cc:729] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:07.249094 25594 raft_consensus.cc:504] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.238397 25280 leader_election.cc:288] T 6c61756fb1434eeaa0f728ccb1894def P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:07.326424 23662 leader_election.cc:302] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: d28e736aee9f4f01b013de670a762697
I20260807 13:41:07.257313 24739 raft_consensus.cc:504] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.283110 25637 raft_consensus.cc:2726] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:41:07.289407 25038 leader_election.cc:288] T e870c19541754909a8880cfcb379933c P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:07.288978 25000 consensus_queue.cc:237] T 830e8cb8ce434e6391c09530c677a61d P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.290465 23818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45360 (request call id 706) took 1370 ms. Trace:
I20260807 13:41:07.291122 25582 raft_consensus.cc:2726] T f2f67b0d087a474ea05fb3c7ceb2f5ae P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:41:07.028844 25449 consensus_queue.cc:1046] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.250s
I20260807 13:41:07.251338 25622 raft_consensus.cc:2726] T e6df7e3fe3a74e6d818aeb532b42d6ba P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 13:41:07.303114 25610 log.cc:924] Time spent T a53e76fbfae64579bb651f346fd4157c P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.416s user 0.000s sys 0.001s
I20260807 13:41:07.308194 25451 leader_election.cc:288] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:07.278788 25092 raft_consensus.cc:2726] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:07.313787 25443 raft_consensus.cc:482] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:07.275324 25540 raft_consensus.cc:2726] T daaea1dffb5443f4858c40ca25e7830e P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:41:07.311403 23821 raft_consensus.cc:2396] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:41:07.242274 25513 raft_consensus.cc:504] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.315914 23660 leader_election.cc:302] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:07.299889 23769 leader_election.cc:302] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:41:07.249482 25573 raft_consensus.cc:504] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.022320 25455 raft_consensus.cc:504] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.326396 23590 raft_consensus.cc:1226] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 4. Current term is 5. Ops: []
I20260807 13:41:07.333132 23818 rpcz_store.cc:276] 0807 13:41:05.929893 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:06.723180 (+793287us) service_pool.cc:227] Handling call
0807 13:41:06.723516 (+ 336us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:41:06.863077 (+139561us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:41:06.863118 (+ 41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:41:06.898989 (+ 35871us) log.cc:842] Serialized 26 byte log entry
0807 13:41:07.007681 (+108692us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:41:07.007713 (+ 32us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:07.007779 (+ 66us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:41:07.290204 (+282425us) raft_consensus.cc:1671] finished
0807 13:41:07.290226 (+ 22us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:41:07.290391 (+ 165us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":27065,"raft.queue_time_us":90512,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":10553,"thread_start_us":178875,"threads_started":2,"wal-append.queue_time_us":373957}
I20260807 13:41:07.345294 23818 raft_consensus.cc:1261] T e870c19541754909a8880cfcb379933c P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260807 13:41:07.320963 25495 consensus_meta.cc:287] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812: Time spent flushing consensus metadata: real 0.940s user 0.007s sys 0.009s
I20260807 13:41:07.319600 25524 raft_consensus.cc:2726] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:07.317226 25419 raft_consensus.cc:482] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:07.270977 25599 leader_election.cc:288] T 1d0fa316c27e4c899031825c69b57f1d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:07.290735 25603 consensus_queue.cc:237] T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.342273 23700 raft_consensus.cc:2379] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 5: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:41:07.346537 23818 raft_consensus.cc:3037] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:07.353561 23660 leader_election.cc:302] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:41:07.354560 25634 raft_consensus.cc:2726] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 13:41:07.355194 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:41:07.337774 25409 consensus_meta.cc:287] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.610s user 0.007s sys 0.008s
I20260807 13:41:07.422099 25409 raft_consensus.cc:504] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.423406 23702 raft_consensus.cc:1226] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 4. Current term is 5. Ops: []
W20260807 13:41:07.392138 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 92357.6us
I20260807 13:41:07.392858 25637 raft_consensus.cc:2726] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260807 13:41:07.423998 25506 consensus_meta.cc:287] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812: Time spent flushing consensus metadata: real 0.933s user 0.014s sys 0.001s
I20260807 13:41:07.424515 25506 raft_consensus.cc:504] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.427517 25409 leader_election.cc:288] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:07.341650 23815 raft_consensus.cc:1261] T 910844a7b519444faad288ab2098a066 P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:41:07.226454 25629 raft_consensus.cc:504] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:41:07.407979 25633 log.cc:924] Time spent T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.319s user 0.000s sys 0.001s
I20260807 13:41:07.335235 25418 consensus_queue.cc:1035] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260807 13:41:07.394418 25495 raft_consensus.cc:504] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.409644 25455 leader_election.cc:288] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:07.323719 25354 raft_consensus.cc:504] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:41:07.412590 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 59104.5us
I20260807 13:41:07.456810 23660 leader_election.cc:302] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:07.326313 25388 raft_consensus.cc:504] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.418373 23823 raft_consensus.cc:3037] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:07.063067 25621 raft_consensus.cc:504] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.340656 24905 raft_consensus.cc:2781] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:41:07.428369 23769 leader_election.cc:302] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:07.357190 25503 leader_election.cc:288] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:07.352134 25443 raft_consensus.cc:504] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
@ 0x7f4619369875 testing::internal::UnitTestImpl::RunAllTests() at ??:0
I20260807 13:41:07.400950 25540 raft_consensus.cc:2741] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260807 13:41:07.480432 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:07.481257 23711 raft_consensus.cc:2454] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:41:07.484630 25573 leader_election.cc:288] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:07.401470 25571 raft_consensus.cc:482] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:41:07.486958 25571 raft_consensus.cc:3037] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Advancing to term 5
W20260807 13:41:07.490808 25569 log.cc:924] Time spent T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 1.578s user 0.030s sys 0.043s
W20260807 13:41:07.491228 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 62960.9us
I20260807 13:41:07.492439 23769 leader_election.cc:302] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:07.492955 25635 consensus_queue.cc:1035] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.162s
I20260807 13:41:07.493818 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 784) took 1018 ms. Trace:
I20260807 13:41:07.495020 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:07.496229 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:07.494210 23704 rpcz_store.cc:276] 0807 13:41:06.475569 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:06.498237 (+ 22668us) service_pool.cc:227] Handling call
0807 13:41:06.509556 (+ 11319us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:41:06.979021 (+469465us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:07.493496 (+514475us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b54003809d4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:41:07.493744 (+ 248us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":988311424}
W20260807 13:41:07.496889 25646 log.cc:924] Time spent T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.098s user 0.000s sys 0.001s
I20260807 13:41:07.497756 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689213e52b434d3bb11b840c79916a65" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:07.500051 23769 leader_election.cc:302] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:07.500350 23704 raft_consensus.cc:2454] T 689213e52b434d3bb11b840c79916a65 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 4.
W20260807 13:41:07.461794 25454 consensus_meta.cc:287] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.604s user 0.015s sys 0.000s
I20260807 13:41:07.501574 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:07.502082 23704 raft_consensus.cc:3037] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:07.503480 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c1184114b02410098331e68d3b8d4cf" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:07.505030 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:07.505705 23711 raft_consensus.cc:3037] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 5
I20260807 13:41:07.505738 23823 raft_consensus.cc:1261] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:41:07.510504 25506 leader_election.cc:288] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:07.514911 25629 leader_election.cc:288] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:41:07.515528 25574 log.cc:924] Time spent T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.064s user 0.000s sys 0.000s
I20260807 13:41:07.449451 23818 raft_consensus.cc:1261] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:41:07.430107 25408 raft_consensus.cc:2781] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:41:07.461953 23660 leader_election.cc:302] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:07.516525 25408 raft_consensus.cc:482] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:41:07.516945 25408 raft_consensus.cc:3037] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:41:07.517015 23660 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 55136.8us
I20260807 13:41:07.451997 25476 leader_election.cc:288] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:07.402774 23812 consensus_queue.cc:260] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.470531 23595 raft_consensus.cc:2454] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:07.473054 25495 leader_election.cc:288] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:07.474929 25354 leader_election.cc:288] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:07.470112 25634 raft_consensus.cc:2781] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:07.475659 25513 leader_election.cc:288] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:07.476419 24905 raft_consensus.cc:686] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:07.477250 25388 leader_election.cc:288] T fd31593673b040a184ccd6160a9674de P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:07.477883 23825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45360 (request call id 708) took 1546 ms. Trace:
I20260807 13:41:07.478302 25443 leader_election.cc:288] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:07.511125 23599 raft_consensus.cc:1226] T 0f4062e0223a4cc0b2e448e35445671d P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 1. Current term is 2. Ops: []
I20260807 13:41:07.411628 25419 raft_consensus.cc:504] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.518769 23660 leader_election.cc:302] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
W20260807 13:41:07.453718 25566 consensus_meta.cc:287] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.821s user 0.008s sys 0.005s
I20260807 13:41:07.534088 23825 rpcz_store.cc:276] 0807 13:41:05.931269 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:06.724515 (+793246us) service_pool.cc:227] Handling call
0807 13:41:06.724899 (+ 384us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:41:06.831339 (+106440us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:41:06.831370 (+ 31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:41:06.832075 (+ 705us) log.cc:842] Serialized 26 byte log entry
0807 13:41:07.220364 (+388289us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:41:07.220414 (+ 50us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:07.220519 (+ 105us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:41:07.477644 (+257125us) raft_consensus.cc:1671] finished
0807 13:41:07.477669 (+ 25us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:41:07.477817 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":38637,"raft.queue_time_us":106390,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":8153,"thread_start_us":437135,"threads_started":2,"wal-append.queue_time_us":593301}
I20260807 13:41:07.528877 23769 leader_election.cc:302] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:07.539072 23704 raft_consensus.cc:2454] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 5.
I20260807 13:41:07.542783 23599 raft_consensus.cc:1226] T 4f2c88606c274605948654e7a33c9982 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:07.543249 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:07.543987 23704 raft_consensus.cc:2379] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 5: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:41:07.521265 25540 raft_consensus.cc:2726] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 13:41:07.549618 23660 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.82.67:46685 timed out after 2.030s (SENT) [suppressed 30 similar messages]
I20260807 13:41:07.552356 23769 leader_election.cc:302] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:07.553593 23769 leader_election.cc:302] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:07.554531 23769 leader_election.cc:302] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:07.527719 25635 raft_consensus.cc:2726] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:41:07.530730 25503 raft_consensus.cc:3037] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:07.556720 23769 leader_election.cc:302] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:07.558048 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:07.558785 23704 raft_consensus.cc:2454] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 5.
I20260807 13:41:07.532226 25634 raft_consensus.cc:482] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:07.559065 23769 leader_election.cc:302] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:41:07.559762 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e870c19541754909a8880cfcb379933c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:07.568181 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f871ca72ef417aa877002c8166b44c" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:07.533809 25651 raft_consensus.cc:2726] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:41:07.557610 25000 consensus_queue.cc:1035] T a53e76fbfae64579bb651f346fd4157c P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260807 13:41:07.563824 25622 consensus_queue.cc:1035] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260807 13:41:07.521369 25454 raft_consensus.cc:504] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.582919 25454 leader_election.cc:288] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:07.584142 25269 raft_consensus.cc:482] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:41:07.584710 25269 raft_consensus.cc:504] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.585429 23590 raft_consensus.cc:1261] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:41:07.557871 25629 raft_consensus.cc:2726] T c9552d42b445450691daef21fba4059a P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:07.587421 25446 raft_consensus.cc:2781] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:41:07.587669 23594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 773) took 1406 ms. Trace:
I20260807 13:41:07.588006 25446 raft_consensus.cc:482] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:07.588598 25446 raft_consensus.cc:3037] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
W20260807 13:41:07.589212 23821 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45360 (request call id 703) took 1781 ms (client timeout 2040 ms). Trace:
W20260807 13:41:07.589576 23821 rpcz_store.cc:269] 0807 13:41:05.808036 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:06.339287 (+531251us) service_pool.cc:227] Handling call
0807 13:41:07.589023 (+1249736us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b5400348fd4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:41:07.589155 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2232588672}
I20260807 13:41:07.539785 24739 leader_election.cc:288] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:07.592458 24739 raft_consensus.cc:2726] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:07.577217 23769 leader_election.cc:302] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:07.555856 25443 raft_consensus.cc:2726] T aa5fcc43292246d486ebba83eac423d6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:41:07.532100 25449 consensus_queue.cc:1035] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260807 13:41:07.594586 23590 raft_consensus.cc:1261] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:41:07.594976 23707 raft_consensus.cc:1226] T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260807 13:41:07.596042 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "830e8cb8ce434e6391c09530c677a61d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:07.596361 25419 leader_election.cc:288] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:07.597219 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:07.599319 25070 raft_consensus.cc:482] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:07.600186 25062 raft_consensus.cc:482] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:07.558194 25524 raft_consensus.cc:2726] T 79f871ca72ef417aa877002c8166b44c P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:41:07.600749 25062 raft_consensus.cc:504] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.564673 25354 consensus_queue.cc:1035] T fbac6e18ecd14ba2a7d3e846a9fc81bf P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.041s
I20260807 13:41:07.561223 25582 raft_consensus.cc:2726] T fbac6e18ecd14ba2a7d3e846a9fc81bf P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:41:07.598542 23711 raft_consensus.cc:2454] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 5.
I20260807 13:41:07.558878 25654 raft_consensus.cc:2726] T 7985ff913681417583d257589c2e4020 P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:41:07.558712 25476 consensus_queue.cc:1035] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260807 13:41:07.605219 23598 raft_consensus.cc:1261] T f299697fb7db462dad6c590a8cfea499 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:41:07.607107 23598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 738) took 1007 ms. Trace:
I20260807 13:41:07.606935 24905 consensus_queue.cc:237] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.607672 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:07.609076 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:07.609869 23591 raft_consensus.cc:2379] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 4: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:41:07.557968 25513 raft_consensus.cc:3037] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:07.611013 25092 consensus_queue.cc:1046] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:41:07.611281 25524 raft_consensus.cc:2726] T ab56376b2d7c4e52826236ef52452731 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:41:07.611945 25524 raft_consensus.cc:3032] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:41:07.541973 25566 raft_consensus.cc:504] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.612251 25524 raft_consensus.cc:729] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:07.613171 25524 consensus_queue.cc:260] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.599852 25070 raft_consensus.cc:504] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:41:07.615962 25595 consensus_meta.cc:287] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.600s user 0.012s sys 0.002s
I20260807 13:41:07.616369 25595 raft_consensus.cc:504] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.607427 23598 rpcz_store.cc:276] 0807 13:41:06.599578 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:06.754593 (+155015us) service_pool.cc:227] Handling call
0807 13:41:06.756893 (+ 2300us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:41:07.605689 (+848796us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:07.606876 (+ 1187us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b54002549d4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:41:07.607049 (+ 173us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1950165248}
I20260807 13:41:07.617676 23702 raft_consensus.cc:2379] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 6: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:41:07.614460 25524 raft_consensus.cc:3037] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:07.618515 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:07.619894 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "830e8cb8ce434e6391c09530c677a61d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:07.620514 23598 raft_consensus.cc:2454] T 830e8cb8ce434e6391c09530c677a61d P 08757cfbeffb41bbab14c2ef00e9d812 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:41:07.616623 25070 leader_election.cc:288] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:07.620929 23769 leader_election.cc:302] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:41:07.628409 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:07.610641 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:07.588137 23594 rpcz_store.cc:276] 0807 13:41:06.180857 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:06.383769 (+202912us) service_pool.cc:227] Handling call
0807 13:41:06.384062 (+ 293us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:41:06.683312 (+299250us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:07.587451 (+904139us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b54003c5354. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:41:07.587612 (+ 161us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":670024960}
W20260807 13:41:07.575409 25597 consensus_meta.cc:287] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 1.229s user 0.011s sys 0.007s
I20260807 13:41:07.640561 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:07.671890 23598 raft_consensus.cc:2379] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 4: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:41:07.562108 25634 raft_consensus.cc:3037] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:07.675175 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0a69bc60e24041b730133061e67069" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:07.675501 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:07.629271 23591 raft_consensus.cc:2454] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 4.
I20260807 13:41:07.676656 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:07.677068 23600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 745) took 1069 ms. Trace:
I20260807 13:41:07.572794 25540 raft_consensus.cc:482] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:07.680341 23703 raft_consensus.cc:2379] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 6: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:41:07.680382 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:07.681103 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:07.681736 23704 raft_consensus.cc:2454] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 5.
I20260807 13:41:07.681901 23598 raft_consensus.cc:2454] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:41:07.682713 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:07.684074 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d0fa316c27e4c899031825c69b57f1d" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:07.684262 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a180725c9e34d0095ab423614678d88" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:07.575600 25594 leader_election.cc:288] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:07.685335 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:07.677418 23600 rpcz_store.cc:276] 0807 13:41:06.607943 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:06.978694 (+370751us) service_pool.cc:227] Handling call
0807 13:41:06.979046 (+ 352us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:41:06.979288 (+ 242us) raft_consensus.cc:1520] Early marking committed up to index 3
0807 13:41:06.995986 (+ 16698us) log.cc:842] Serialized 14 byte log entry
0807 13:41:07.676741 (+680755us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:41:07.676795 (+ 54us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:41:07.676836 (+ 41us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:07.676894 (+ 58us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:41:07.677013 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":589095,"prepare.queue_time_us":17460,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":3113,"raft.queue_time_us":596846,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":91313,"threads_started":1}
I20260807 13:41:07.686393 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:07.682896 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:07.683638 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:07.689698 23825 raft_consensus.cc:2454] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 5.
I20260807 13:41:07.690505 23825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:07.691009 23598 raft_consensus.cc:2454] T 1099c0db8e4147fd86d0e1ba1162ab82 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 5.
I20260807 13:41:07.691762 23598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:07.692881 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:07.693471 23600 raft_consensus.cc:2454] T 9ccbe9b13e784aaca48d07dff333695a P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 5.
I20260807 13:41:07.694401 23600 raft_consensus.cc:3037] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:07.695089 23594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:07.567112 25458 consensus_queue.cc:1035] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.108s
W20260807 13:41:07.676759 25430 consensus_meta.cc:287] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.696s user 0.008s sys 0.005s
I20260807 13:41:07.704335 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:07.706617 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:07.714466 23591 raft_consensus.cc:3037] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:07.715466 23769 leader_election.cc:302] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:07.708220 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:07.668530 25092 raft_consensus.cc:2781] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:41:07.677450 25651 raft_consensus.cc:482] T 7a180725c9e34d0095ab423614678d88 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:07.674595 25476 raft_consensus.cc:482] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:07.692412 25449 raft_consensus.cc:482] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:07.686779 25419 consensus_queue.cc:1035] T 79f871ca72ef417aa877002c8166b44c P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260807 13:41:07.684962 25654 raft_consensus.cc:482] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:07.678896 25354 consensus_queue.cc:1035] T 0f4062e0223a4cc0b2e448e35445671d P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260807 13:41:07.708974 25635 consensus_queue.cc:1035] T e870c19541754909a8880cfcb379933c P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260807 13:41:07.746631 23707 raft_consensus.cc:1226] T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 LEADER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 3. Current term is 4. Ops: []
I20260807 13:41:07.721516 23600 raft_consensus.cc:1261] T b8004e179e4945ada49709b2ebf227e7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260807 13:41:07.732897 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 747029us
I20260807 13:41:07.748929 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:07.741830 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:07.749560 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:07.750319 23600 raft_consensus.cc:3037] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 5
I20260807 13:41:07.710137 25458 consensus_queue.cc:1225] T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Peer d28e736aee9f4f01b013de670a762697 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260807 13:41:07.758268 23554 leader_election.cc:302] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:41:07.730886 25595 leader_election.cc:288] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 6 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:07.720312 25269 leader_election.cc:288] T ab56376b2d7c4e52826236ef52452731 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:07.721127 25062 leader_election.cc:288] T 18a5485342aa448ba6cfe5f9c07eb43d P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:07.720539 25440 raft_consensus.cc:2781] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Leader pre-election won for term 6
@ 0x7f4619375d50 testing::internal::HandleExceptionsInMethodIfSupported<>() at ??:0
I20260807 13:41:07.769475 25440 raft_consensus.cc:482] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:07.769975 25440 raft_consensus.cc:3037] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:41:07.699420 25433 consensus_queue.cc:1035] T a8d8d3a6cd704602b71ac7d5122cf9cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260807 13:41:07.721216 25652 consensus_queue.cc:1035] T 910844a7b519444faad288ab2098a066 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.054s
I20260807 13:41:07.775377 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53e76fbfae64579bb651f346fd4157c" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:07.776384 23709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 797) took 1010 ms. Trace:
I20260807 13:41:07.734014 25418 raft_consensus.cc:482] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:07.694538 25540 raft_consensus.cc:504] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.721716 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d8d3a6cd704602b71ac7d5122cf9cf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:07.720337 25092 raft_consensus.cc:482] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:07.767083 23597 raft_consensus.cc:1226] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 13:41:07.705044 25443 consensus_queue.cc:1035] T ab56376b2d7c4e52826236ef52452731 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
W20260807 13:41:07.766340 23601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 723) took 1587 ms (client timeout 1626 ms). Trace:
I20260807 13:41:07.776746 23709 rpcz_store.cc:276] 0807 13:41:06.765591 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:06.765827 (+ 236us) service_pool.cc:227] Handling call
0807 13:41:07.775178 (+1009351us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b5800004598. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f4620fef1b0 00007f4620feea94 00007f461a6d6c04 00007f461a6d6b92
0807 13:41:07.776317 (+ 1139us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4714880}
W20260807 13:41:07.787966 23601 rpcz_store.cc:269] 0807 13:41:06.178945 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:06.187310 (+ 8365us) service_pool.cc:227] Handling call
0807 13:41:06.581745 (+394435us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b5800001898. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f4620fef1b0 00007f4620feea94 00007f461a6d6c04 00007f461a6d6b92
0807 13:41:06.624523 (+ 42778us) spinlock_profiling.cc:243] Waited 5.49 ms on lock 0x7b5800001898. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914db7c 00007f461914d73b 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f4620fef1b0 00007f4620feea94 00007f461a6d6c04 00007f461a6d6b92
0807 13:41:07.766101 (+1141578us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54003c4454. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:41:07.766283 (+ 182us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":559315456}
I20260807 13:41:07.722865 25594 consensus_queue.cc:1035] T 18a5485342aa448ba6cfe5f9c07eb43d P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260807 13:41:07.694329 25600 consensus_queue.cc:1035] T f8c48f8bcc0a41aa9267cc72e645a3ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260807 13:41:07.755784 24905 raft_consensus.cc:482] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:07.721076 25573 consensus_queue.cc:1035] T 4c6c66dd2185444995b276c0cf4000c8 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
I20260807 13:41:07.799038 23769 leader_election.cc:302] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:07.760828 25409 raft_consensus.cc:482] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:07.760635 25455 raft_consensus.cc:482] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:07.717558 25430 raft_consensus.cc:504] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.804831 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0a63d9cc9e4b7bad0c1d1a83f10228" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:07.675170 25597 raft_consensus.cc:504] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.745847 25654 raft_consensus.cc:504] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.810460 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:07.740912 25476 raft_consensus.cc:504] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.745721 25449 raft_consensus.cc:504] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:41:07.798039 23814 consensus_meta.cc:287] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 1.286s user 0.012s sys 0.006s
I20260807 13:41:07.819931 23662 leader_election.cc:302] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:07.787873 25092 raft_consensus.cc:3037] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:07.829221 23710 raft_consensus.cc:1203] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[2.2-4.3] Dedup: 2.2->[4.3-4.3]
I20260807 13:41:07.831204 23662 leader_election.cc:302] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:07.800711 25433 raft_consensus.cc:482] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:07.831619 23710 raft_consensus.cc:1226] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260807 13:41:07.798317 23815 raft_consensus.cc:2362] T a8d8d3a6cd704602b71ac7d5122cf9cf P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 5. Re-sending same reply.
I20260807 13:41:07.835073 23710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 795) took 1074 ms. Trace:
I20260807 13:41:07.835500 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:07.734921 25651 raft_consensus.cc:504] T 7a180725c9e34d0095ab423614678d88 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.835551 23710 rpcz_store.cc:276] 0807 13:41:06.760952 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:06.761074 (+ 122us) service_pool.cc:227] Handling call
0807 13:41:07.828746 (+1067672us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b5800004598. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f46210032b0 00007f4620fee7f9 00007f4620fee2a2 00007f461a6d4684
0807 13:41:07.828979 (+ 233us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:41:07.834799 (+ 5820us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:07.835020 (+ 221us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2379136}
I20260807 13:41:07.844985 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "830e8cb8ce434e6391c09530c677a61d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:07.852131 23591 raft_consensus.cc:2454] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 5.
I20260807 13:41:07.853413 23591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812"
I20260807 13:41:07.854215 23591 raft_consensus.cc:3037] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:41:07.861060 23600 raft_consensus.cc:2454] T 09c37fe84a4c44ef8aa1fa514c7179b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 5.
I20260807 13:41:07.862308 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "08757cfbeffb41bbab14c2ef00e9d812" is_pre_election: true
I20260807 13:41:07.864395 23600 raft_consensus.cc:2354] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 4. Current term is 5.
I20260807 13:41:07.796062 25418 raft_consensus.cc:504] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.866639 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce8e1212162485cb6c2d7c393e99399" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:07.824101 25638 raft_consensus.cc:2726] T a53e76fbfae64579bb651f346fd4157c P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:41:07.868911 23591 raft_consensus.cc:2454] T 3effc170900e450eb8126db59a299ab7 P 08757cfbeffb41bbab14c2ef00e9d812 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 6.
I20260807 13:41:07.869609 23710 raft_consensus.cc:2454] T 1ce8e1212162485cb6c2d7c393e99399 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 5.
I20260807 13:41:07.828325 23814 raft_consensus.cc:2454] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 5.
I20260807 13:41:07.805538 24905 raft_consensus.cc:504] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.800858 25582 consensus_queue.cc:1046] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260807 13:41:07.819121 25409 raft_consensus.cc:504] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.878042 23823 raft_consensus.cc:2379] T 7a180725c9e34d0095ab423614678d88 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 1: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:41:07.882764 23820 raft_consensus.cc:1261] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:41:07.824476 25622 consensus_queue.cc:1035] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260807 13:41:07.876081 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:07.813953 25629 consensus_queue.cc:1046] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260807 13:41:07.822288 25455 raft_consensus.cc:504] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.866530 25652 raft_consensus.cc:2726] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:41:07.831169 25419 consensus_queue.cc:1035] T f299697fb7db462dad6c590a8cfea499 P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 0, Time since last communication: 0.046s
W20260807 13:41:07.899937 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 88438.1us
I20260807 13:41:07.906260 23772 leader_election.cc:302] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:07.909204 25418 leader_election.cc:288] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:41:07.912099 25656 log.cc:924] Time spent T 620e30fb1ff34164a7a4f66804acc719 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.098s user 0.000s sys 0.001s
I20260807 13:41:07.899399 23600 pending_rounds.cc:76] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812: Aborting all ops after (but not including) 1
I20260807 13:41:07.915824 23600 pending_rounds.cc:97] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260807 13:41:07.917300 25451 raft_consensus.cc:3032] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:41:07.917866 25451 raft_consensus.cc:729] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:07.919059 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d879feba30417e9919fc152b543506" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:07.919795 23711 raft_consensus.cc:3037] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:07.920867 25446 raft_consensus.cc:504] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:41:07.922070 25669 log.cc:924] Time spent T 7985ff913681417583d257589c2e4020 P 08757cfbeffb41bbab14c2ef00e9d812: Append to log took a long time: real 0.056s user 0.000s sys 0.000s
I20260807 13:41:07.922509 23821 raft_consensus.cc:2379] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 4: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:41:07.895510 23813 raft_consensus.cc:2379] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 in current term 6: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:41:07.923403 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6c66dd2185444995b276c0cf4000c8" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:07.924206 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f299697fb7db462dad6c590a8cfea499" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:07.924564 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
W20260807 13:41:07.924916 23813 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45370 (request call id 560) took 1473 ms (client timeout 1750 ms). Trace:
I20260807 13:41:07.925244 23702 raft_consensus.cc:2454] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 5.
I20260807 13:41:07.876525 25600 raft_consensus.cc:2781] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:07.926699 25446 leader_election.cc:288] T bd314efc5fa240fe8e411f52346a18f1 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:07.926891 25600 raft_consensus.cc:482] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:07.927663 23821 raft_consensus.cc:2362] T f299697fb7db462dad6c590a8cfea499 P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 5. Re-sending same reply.
I20260807 13:41:07.916121 23600 raft_consensus.cc:2866] T 910844a7b519444faad288ab2098a066 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:41:07.926189 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:07.876370 25566 leader_election.cc:288] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 6 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:07.929245 23599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 748) took 1089 ms. Trace:
I20260807 13:41:07.929602 23702 raft_consensus.cc:2454] T 68ed0b32f1864122a6a9a014c0217c01 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 3.
I20260807 13:41:07.927597 25600 raft_consensus.cc:3037] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:07.918294 24905 leader_election.cc:288] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:41:07.925596 23813 rpcz_store.cc:269] 0807 13:41:06.451122 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:06.508642 (+ 57520us) service_pool.cc:227] Handling call
0807 13:41:07.924627 (+1415985us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54002e22d4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:41:07.924823 (+ 196us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2788675840}
I20260807 13:41:07.931116 25440 raft_consensus.cc:504] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.937258 25451 consensus_queue.cc:260] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.942198 23710 raft_consensus.cc:2454] T 9ccbe9b13e784aaca48d07dff333695a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 5.
I20260807 13:41:07.945801 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:07.944489 23711 raft_consensus.cc:2454] T 72d879feba30417e9919fc152b543506 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 5.
I20260807 13:41:07.944211 23599 rpcz_store.cc:276] 0807 13:41:06.840400 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:07.543765 (+703365us) service_pool.cc:227] Handling call
0807 13:41:07.544175 (+ 410us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:41:07.621554 (+ 77379us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:41:07.621590 (+ 36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:41:07.637670 (+ 16080us) log.cc:842] Serialized 26 byte log entry
0807 13:41:07.800549 (+162879us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:41:07.800599 (+ 50us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:07.800755 (+ 156us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:41:07.929010 (+128255us) raft_consensus.cc:1671] finished
0807 13:41:07.929030 (+ 20us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:41:07.929167 (+ 137us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":77195,"raft.queue_time_us":77435,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":46349,"thread_start_us":91258,"threads_started":1,"wal-append.queue_time_us":156953}
I20260807 13:41:07.877843 25454 raft_consensus.cc:482] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:07.842212 25433 raft_consensus.cc:504] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:07.953207 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab56376b2d7c4e52826236ef52452731" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:07.949959 23772 leader_election.cc:302] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:07.954491 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:07.956657 23821 raft_consensus.cc:2396] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260807 13:41:07.892832 23814 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45360 (request call id 710) took 1960 ms (client timeout 2030 ms). Trace:
I20260807 13:41:07.960296 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:07.960924 23702 raft_consensus.cc:2379] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 5: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:41:07.962590 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd31593673b040a184ccd6160a9674de" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:07.964671 23702 raft_consensus.cc:3037] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:07.909192 25409 leader_election.cc:288] T 92e077211c2d4b67b9560872e943322f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:07.967147 23772 leader_election.cc:302] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:07.968925 23772 leader_election.cc:302] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:07.971529 23707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 806) took 1129 ms. Trace:
W20260807 13:41:07.979202 23662 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 148069us
I20260807 13:41:07.971911 23707 rpcz_store.cc:276] 0807 13:41:06.842419 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:07.598157 (+755738us) service_pool.cc:227] Handling call
0807 13:41:07.598434 (+ 277us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:41:07.747111 (+148677us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:07.971343 (+224232us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b5400071054. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:41:07.971483 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":340397952}
I20260807 13:41:07.985919 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:08.028673 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a5485342aa448ba6cfe5f9c07eb43d" candidate_uuid: "08757cfbeffb41bbab14c2ef00e9d812" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:07.954068 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c37fe84a4c44ef8aa1fa514c7179b6" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:08.083729 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:07.954329 25582 raft_consensus.cc:2726] T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:08.080405 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 807) took 1126 ms. Trace:
W20260807 13:41:08.081900 23772 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.65:33187, user_credentials={real_user=slave}} blocked reactor thread for 113047us
I20260807 13:41:08.085557 23772 leader_election.cc:302] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:08.087275 23597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43828 (request call id 781) took 1457 ms. Trace:
I20260807 13:41:08.085214 23700 rpcz_store.cc:276] 0807 13:41:06.845027 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:06.883401 (+ 38374us) service_pool.cc:227] Handling call
0807 13:41:07.971171 (+1087770us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b540039a3d4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:41:07.971317 (+ 146us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1030447360}
I20260807 13:41:08.087591 23597 rpcz_store.cc:276] 0807 13:41:06.629863 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:07.226491 (+596628us) service_pool.cc:227] Handling call
0807 13:41:07.766857 (+540366us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:41:07.779497 (+ 12640us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:08.087123 (+307626us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b54003c4450. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0aca09 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:41:08.087228 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1241716992}
I20260807 13:41:08.089939 23707 raft_consensus.cc:1261] T 8624086fc56b47cf914a4540b2ba3ae1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Refusing update from remote peer d28e736aee9f4f01b013de670a762697: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:41:07.965674 25638 raft_consensus.cc:2781] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:41:07.957872 25454 raft_consensus.cc:504] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:08.104198 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2e5e45fca749498a80852c430edb21" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:08.104717 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc716b3423f48deb7798cbf9e86d821" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:08.105595 23821 raft_consensus.cc:2454] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:08.104974 23817 raft_consensus.cc:2454] T cf2e5e45fca749498a80852c430edb21 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:08.080121 25622 raft_consensus.cc:2781] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260807 13:41:08.109591 25667 log.cc:924] Time spent T 7472ae891a234d26a82a6d485d983386 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.164s user 0.000s sys 0.002s
W20260807 13:41:08.132385 25665 log.cc:924] Time spent T 4f2c88606c274605948654e7a33c9982 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.284s user 0.000s sys 0.004s
W20260807 13:41:08.136592 23595 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 727) took 1956 ms (client timeout 2222 ms). Trace:
I20260807 13:41:08.137092 25433 leader_election.cc:288] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:41:08.114917 23535 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:41:08.138183 25430 leader_election.cc:288] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:41:07.962067 23814 rpcz_store.cc:269] 0807 13:41:05.932243 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:06.382611 (+450368us) service_pool.cc:227] Handling call
0807 13:41:07.885401 (+1502790us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:41:08.142553 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47672 (request call id 808) took 1297 ms. Trace:
I20260807 13:41:08.116031 23815 raft_consensus.cc:2379] T 09c37fe84a4c44ef8aa1fa514c7179b6 P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 5: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:41:08.087000 25678 raft_consensus.cc:2781] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:08.122612 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7800087414314b9983dee88fd1b6ccb5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:08.140611 25455 leader_election.cc:288] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:08.126143 23707 raft_consensus.cc:1226] T 2f0a69bc60e24041b730133061e67069 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260807 13:41:08.137030 23595 rpcz_store.cc:269] 0807 13:41:06.180244 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:06.314112 (+133868us) service_pool.cc:227] Handling call
0807 13:41:06.517132 (+203020us) spinlock_profiling.cc:243] Waited 6.28 ms on lock 0x7b5800001898. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f4618fc9f11 00007f461914d851 00007f461914d702 00007f462203db09 00007f4620f79730 00007f462103f79b 00007f462103f821 00007f4620fef1b0 00007f4620feea94 00007f461a6d6c04 00007f461a6d6b92
0807 13:41:08.136385 (+1619253us) spinlock_profiling.cc:243] Waited 952 ms on lock 0x7b5400055ad4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:41:08.136525 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2205002368}
I20260807 13:41:08.111207 25677 raft_consensus.cc:482] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d28e736aee9f4f01b013de670a762697)
I20260807 13:41:08.181264 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46f16bbd2f64224b67d0da4707f8f2f" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:08.182104 23821 raft_consensus.cc:3037] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:41:08.094201 25638 raft_consensus.cc:482] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:08.143070 23703 rpcz_store.cc:276] 0807 13:41:06.845380 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:07.354779 (+509399us) service_pool.cc:227] Handling call
0807 13:41:08.142306 (+787527us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b5400381dd4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:41:08.142478 (+ 172us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":597112704}
I20260807 13:41:08.124181 25654 leader_election.cc:288] T f8c48f8bcc0a41aa9267cc72e645a3ca P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:07.973261 25446 consensus_queue.cc:1046] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.153s
I20260807 13:41:08.179167 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 775) took 1793 ms. Trace:
I20260807 13:41:08.151533 23817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
W20260807 13:41:08.127599 25571 consensus_meta.cc:287] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812: Time spent flushing consensus metadata: real 0.640s user 0.016s sys 0.000s
I20260807 13:41:08.189960 23711 raft_consensus.cc:1226] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 13:41:08.096331 25540 leader_election.cc:288] T 214fb4bbf05e4280a55113485d8ce2f5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:08.126981 25622 raft_consensus.cc:482] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:08.179036 25475 consensus_queue.cc:1035] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:41:08.196823 25622 raft_consensus.cc:3037] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:41:08.187390 23699 rpcz_store.cc:276] 0807 13:41:06.410694 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:06.437769 (+ 27075us) service_pool.cc:227] Handling call
0807 13:41:06.586804 (+149035us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:41:07.089353 (+502549us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:08.178828 (+1089475us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b5400160654. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:41:08.179080 (+ 252us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":933665152}
I20260807 13:41:08.145639 25478 raft_consensus.cc:2781] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:41:08.210126 23817 raft_consensus.cc:2379] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 6: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:41:08.180109 25582 raft_consensus.cc:482] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:08.148471 25678 raft_consensus.cc:482] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:08.176149 25597 leader_election.cc:288] T 3effc170900e450eb8126db59a299ab7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 6 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:08.186394 25638 raft_consensus.cc:3037] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:41:08.199182 25440 leader_election.cc:288] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 6 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:08.200170 25449 leader_election.cc:288] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:08.191947 23813 raft_consensus.cc:2454] T 7800087414314b9983dee88fd1b6ccb5 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
W20260807 13:41:08.229846 25634 consensus_meta.cc:287] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.537s user 0.006s sys 0.008s
I20260807 13:41:08.214773 25478 raft_consensus.cc:482] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:08.228195 23821 raft_consensus.cc:2454] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 6.
I20260807 13:41:08.188175 25571 raft_consensus.cc:504] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:08.223658 25651 leader_election.cc:288] T 7a180725c9e34d0095ab423614678d88 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:08.224661 25678 raft_consensus.cc:3037] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:08.249651 25092 raft_consensus.cc:504] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:08.234176 25634 raft_consensus.cc:504] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:08.224530 25582 raft_consensus.cc:504] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:41:08.234558 25524 consensus_meta.cc:287] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.616s user 0.015s sys 0.000s
I20260807 13:41:08.256592 23709 raft_consensus.cc:2354] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 08757cfbeffb41bbab14c2ef00e9d812 for earlier term 4. Current term is 5.
I20260807 13:41:08.264009 23594 raft_consensus.cc:1226] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Rejecting Update request from peer 8a3af1d071e74f2eb0c821e2bd68fe37 for earlier term 4. Current term is 5. Ops: []
I20260807 13:41:08.234054 25478 raft_consensus.cc:3037] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:41:08.268479 23825 raft_consensus.cc:2396] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260807 13:41:08.272571 23818 raft_consensus.cc:2379] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 4: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:41:08.189245 25677 raft_consensus.cc:504] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:08.287684 23702 raft_consensus.cc:2454] T fd31593673b040a184ccd6160a9674de P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08757cfbeffb41bbab14c2ef00e9d812 in term 5.
I20260807 13:41:08.289459 25454 leader_election.cc:288] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:08.286090 25582 leader_election.cc:288] T 0f4062e0223a4cc0b2e448e35445671d P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
W20260807 13:41:08.316012 25503 consensus_meta.cc:287] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.753s user 0.014s sys 0.002s
W20260807 13:41:08.330039 25158 consensus_meta.cc:287] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 1.012s user 0.015s sys 0.001s
I20260807 13:41:08.330516 25158 raft_consensus.cc:504] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:08.333129 25629 raft_consensus.cc:3032] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:41:08.333505 23704 raft_consensus.cc:2379] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 6: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:41:08.333597 25629 raft_consensus.cc:729] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:08.325496 25503 raft_consensus.cc:2726] T 689213e52b434d3bb11b840c79916a65 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:08.337037 25634 leader_election.cc:288] T ed0a63d9cc9e4b7bad0c1d1a83f10228 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:08.348516 25092 leader_election.cc:288] T d82ae8b5e643448f937e62d82bf888ff P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:08.343963 23812 raft_consensus.cc:3037] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Advancing to term 5
W20260807 13:41:08.351063 25408 consensus_meta.cc:287] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37: Time spent flushing consensus metadata: real 0.834s user 0.016s sys 0.000s
I20260807 13:41:08.351504 25408 raft_consensus.cc:504] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:08.353693 25408 leader_election.cc:288] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 2 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
W20260807 13:41:08.356185 25513 consensus_meta.cc:287] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697: Time spent flushing consensus metadata: real 0.746s user 0.008s sys 0.007s
I20260807 13:41:08.356678 25513 raft_consensus.cc:2726] T 1ce8e1212162485cb6c2d7c393e99399 P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:41:08.358155 25476 leader_election.cc:288] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:08.336848 25629 consensus_queue.cc:260] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:08.361073 25629 raft_consensus.cc:3037] T 4f2c88606c274605948654e7a33c9982 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:08.374486 23812 raft_consensus.cc:1261] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Refusing update from remote peer 8a3af1d071e74f2eb0c821e2bd68fe37: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260807 13:41:08.375385 23812 pending_rounds.cc:76] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697: Aborting all ops after (but not including) 2
I20260807 13:41:08.375823 23812 pending_rounds.cc:97] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260807 13:41:08.375856 25678 raft_consensus.cc:504] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:08.376758 23812 raft_consensus.cc:2866] T 1d0fa316c27e4c899031825c69b57f1d P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260807 13:41:08.362131 25648 log.cc:924] Time spent T 7985ff913681417583d257589c2e4020 P 8a3af1d071e74f2eb0c821e2bd68fe37: Append to log took a long time: real 0.955s user 0.004s sys 0.024s
@ 0x7f4619368e2d testing::UnitTest::Run() at ??:0
@ 0x36966c RUN_ALL_TESTS() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/gtest/gtest.h:?
@ 0x36852d main at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_main.cc:?
I20260807 13:41:08.338887 25571 leader_election.cc:288] T f2f67b0d087a474ea05fb3c7ceb2f5ae P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:08.338143 25158 leader_election.cc:288] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 6 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:08.357933 25677 leader_election.cc:288] T a47d160dba334fd0a32cff0cfc2459c1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:08.335424 25600 raft_consensus.cc:504] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:08.403558 25451 raft_consensus.cc:3037] T aa5fcc43292246d486ebba83eac423d6 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:08.378463 23812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45360 (request call id 729) took 2125 ms. Trace:
I20260807 13:41:08.414605 23700 raft_consensus.cc:1226] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 13:41:08.416942 25600 leader_election.cc:288] T b8004e179e4945ada49709b2ebf227e7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:08.418351 23588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43820 (request call id 740) took 1812 ms. Trace:
I20260807 13:41:08.418779 23588 rpcz_store.cc:276] 0807 13:41:06.605769 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:06.686998 (+ 81229us) service_pool.cc:227] Handling call
0807 13:41:08.418123 (+1731125us) spinlock_profiling.cc:243] Waited 71.2 ms on lock 0x7b54000564d4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:41:08.418284 (+ 161us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":163800448}
I20260807 13:41:08.441767 23590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 750) took 1500 ms. Trace:
W20260807 13:41:08.444182 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 685960us
I20260807 13:41:08.444931 23554 leader_election.cc:302] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:41:08.442240 23590 rpcz_store.cc:276] 0807 13:41:06.941153 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:07.595337 (+654184us) service_pool.cc:227] Handling call
0807 13:41:07.595642 (+ 305us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:41:07.623063 (+ 27421us) raft_consensus.cc:1520] Early marking committed up to index 4
0807 13:41:07.685624 (+ 62561us) log.cc:842] Serialized 14 byte log entry
0807 13:41:07.746826 (+ 61202us) log.cc:842] Serialized 14 byte log entry
0807 13:41:08.332585 (+585759us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b180037ed00. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f46220248b1 00007f4622031661 00007f4619185764 00007f4619188b11 00007f4619188ac9 00007f4619188a59 00007f4619188a21 00007f4619187d1d 00007f46223e9204 00007f46223e9039 00007f4619167dc6
0807 13:41:08.440735 (+108150us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b180037ed00. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f46220248b1 00007f4622031661 00007f46190fc4ca 00007f46227ddf99 00007f4618fc0990 00007f4619182864 00007f4619182155 00007f461c0a53d0 00007f461c0b7576 00007f461c0c80d7 00007f461c0c8058
0807 13:41:08.441190 (+ 455us) log.cc:842] Serialized 14 byte log entry
0807 13:41:08.441385 (+ 195us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:41:08.441431 (+ 46us) raft_consensus.cc:1631] Marking committed up to 4
0807 13:41:08.441475 (+ 44us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:08.441556 (+ 81us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:41:08.441698 (+ 142us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6202,"prepare.queue_time_us":68314,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":89,"raft.queue_time_us":5833,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":7748,"spinlock_wait_cycles":37291136,"thread_start_us":60509,"threads_started":1,"wal-append.queue_time_us":138448}
I20260807 13:41:08.449079 23660 leader_election.cc:302] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:08.449785 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd314efc5fa240fe8e411f52346a18f1" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:08.452124 23660 leader_election.cc:302] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:08.453547 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c48f8bcc0a41aa9267cc72e645a3ca" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:08.453708 23660 leader_election.cc:302] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:08.455062 23769 leader_election.cc:302] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:08.455129 23660 leader_election.cc:302] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:41:08.456301 23769 leader_election.cc:302] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:41:08.456535 23707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4062e0223a4cc0b2e448e35445671d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:08.457335 23769 leader_election.cc:302] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812
I20260807 13:41:08.458201 23769 leader_election.cc:302] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:08.458690 23704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214fb4bbf05e4280a55113485d8ce2f5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:08.459575 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c61756fb1434eeaa0f728ccb1894def" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:08.460109 23702 raft_consensus.cc:3037] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:41:08.463261 23710 raft_consensus.cc:1226] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 LEADER]: Rejecting Update request from peer d28e736aee9f4f01b013de670a762697 for earlier term 4. Current term is 5. Ops: []
I20260807 13:41:08.463621 23555 leader_election.cc:302] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:08.464319 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31124698024d476f89cdf788d21e50b7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:08.464651 23555 leader_election.cc:302] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:08.464960 23710 raft_consensus.cc:2454] T 31124698024d476f89cdf788d21e50b7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 4.
I20260807 13:41:08.465138 23660 leader_election.cc:302] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:08.465571 23554 leader_election.cc:302] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:41:08.465656 23555 leader_election.cc:302] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:08.465961 23660 leader_election.cc:302] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:08.465678 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ae8b5e643448f937e62d82bf888ff" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:08.455504 23703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a180725c9e34d0095ab423614678d88" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:08.475471 25658 raft_consensus.cc:3037] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:08.475884 25472 raft_consensus.cc:2781] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:08.477375 23769 leader_election.cc:302] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d28e736aee9f4f01b013de670a762697; no voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:08.472288 23703 raft_consensus.cc:2454] T 7a180725c9e34d0095ab423614678d88 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 1.
I20260807 13:41:08.476305 25472 raft_consensus.cc:482] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:08.487478 25472 raft_consensus.cc:3037] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:08.487838 23705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a6dd54ac4d4a8b9227a3d3ee9fafb6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:08.488780 23705 raft_consensus.cc:2379] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 5: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:41:08.491119 23813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:08.485642 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e285d5ba5024cee8ad635138ef44fd5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:08.485757 23702 raft_consensus.cc:2454] T 6c61756fb1434eeaa0f728ccb1894def P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 6.
W20260807 13:41:08.546854 23769 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 63969.2us
I20260807 13:41:08.546681 23711 raft_consensus.cc:2454] T 7e285d5ba5024cee8ad635138ef44fd5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 4.
I20260807 13:41:08.548413 23769 leader_election.cc:302] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:08.471684 25092 raft_consensus.cc:2726] T 0dc716b3423f48deb7798cbf9e86d821 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:41:08.474179 25600 raft_consensus.cc:2781] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:08.472837 25476 raft_consensus.cc:2781] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:41:08.471838 25677 raft_consensus.cc:2781] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:41:08.549883 23769 leader_election.cc:302] T 7a180725c9e34d0095ab423614678d88 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:08.472340 25158 raft_consensus.cc:2781] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:08.463459 25062 raft_consensus.cc:2726] T b213bed392294fcfb09b79938e6b85b6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:08.463874 25573 raft_consensus.cc:3037] T bd314efc5fa240fe8e411f52346a18f1 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:08.464143 25690 raft_consensus.cc:482] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:08.464360 25503 raft_consensus.cc:2726] T 4c6c66dd2185444995b276c0cf4000c8 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:08.473946 24905 raft_consensus.cc:2726] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:41:08.472689 25513 raft_consensus.cc:2781] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:41:08.483970 25454 raft_consensus.cc:2726] T f46f16bbd2f64224b67d0da4707f8f2f P d28e736aee9f4f01b013de670a762697 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:41:08.566593 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8004e179e4945ada49709b2ebf227e7" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:08.567816 23769 leader_election.cc:302] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:08.486467 25616 raft_consensus.cc:2781] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:41:08.563613 25475 raft_consensus.cc:482] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:08.592474 23821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c1184114b02410098331e68d3b8d4cf" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:08.592983 25475 raft_consensus.cc:504] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:08.593632 23769 leader_election.cc:302] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:08.594780 25690 raft_consensus.cc:504] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:08.595456 25475 leader_election.cc:288] T e912486c065f413cb2657340dc9a95af P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:08.596086 25475 raft_consensus.cc:2781] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:41:08.596860 25690 leader_election.cc:288] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:08.597429 25513 raft_consensus.cc:482] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:08.597375 23660 leader_election.cc:302] T 7a180725c9e34d0095ab423614678d88 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:08.597963 25513 raft_consensus.cc:3037] T 68ed0b32f1864122a6a9a014c0217c01 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:08.599567 25681 raft_consensus.cc:2726] T 7a180725c9e34d0095ab423614678d88 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:41:08.601552 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2133139b13ce49de9c5a382720699163" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:08.563606 25597 raft_consensus.cc:2781] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:08.607347 25597 raft_consensus.cc:482] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:08.607681 25597 raft_consensus.cc:3037] T 31124698024d476f89cdf788d21e50b7 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:08.563758 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3effc170900e450eb8126db59a299ab7" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:08.609958 23699 raft_consensus.cc:2379] T 3effc170900e450eb8126db59a299ab7 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 6: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
W20260807 13:41:08.571442 23554 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.67:46685, user_credentials={real_user=slave}} blocked reactor thread for 105932us
I20260807 13:41:08.611370 23554 leader_election.cc:302] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:41:08.589118 25621 leader_election.cc:288] T 2133139b13ce49de9c5a382720699163 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:08.478727 25582 consensus_queue.cc:1035] T 8624086fc56b47cf914a4540b2ba3ae1 P d28e736aee9f4f01b013de670a762697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.096s
I20260807 13:41:08.615541 23704 raft_consensus.cc:2454] T 214fb4bbf05e4280a55113485d8ce2f5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 4.
I20260807 13:41:08.476408 25408 raft_consensus.cc:2781] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:41:08.575760 25677 raft_consensus.cc:686] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 6 LEADER]: Becoming Leader. State: Replica: 8a3af1d071e74f2eb0c821e2bd68fe37, State: Running, Role: LEADER
I20260807 13:41:08.473459 25678 leader_election.cc:288] T 1099c0db8e4147fd86d0e1ba1162ab82 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 5 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:08.484629 25038 raft_consensus.cc:482] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:08.576476 25622 raft_consensus.cc:504] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:08.585429 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47d160dba334fd0a32cff0cfc2459c1" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
W20260807 13:41:08.570530 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 104914us
I20260807 13:41:08.617743 23821 raft_consensus.cc:2454] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 2.
I20260807 13:41:08.562781 25600 raft_consensus.cc:482] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:08.624236 23555 leader_election.cc:302] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:08.438254 23812 rpcz_store.cc:276] 0807 13:41:06.253582 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:06.934125 (+680543us) service_pool.cc:227] Handling call
0807 13:41:07.015605 (+ 81480us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:41:08.343512 (+1327907us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b580025b8b0. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c028f63 00007f461c08caba 00007f461c0a43af 00007f461c0a5b4e 00007f461c0afc89 00007f461c0b0556 00007f461c0acedf 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684
0807 13:41:08.377900 (+ 34388us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:08.378210 (+ 310us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1338435456}
I20260807 13:41:08.564908 25476 raft_consensus.cc:482] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:08.580739 25092 raft_consensus.cc:2781] T 7a180725c9e34d0095ab423614678d88 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:41:08.547842 25651 consensus_queue.cc:1046] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260807 13:41:08.573897 25158 raft_consensus.cc:482] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:08.629637 23554 leader_election.cc:302] T 7a180725c9e34d0095ab423614678d88 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37
I20260807 13:41:08.616189 25361 raft_consensus.cc:2781] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:41:08.634156 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "898f2485bfe34aa296ddf8f5c5cfb5ca" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:08.642640 23823 raft_consensus.cc:2454] T 898f2485bfe34aa296ddf8f5c5cfb5ca P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:08.643884 23823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e9a929f1fe4faeb8fc3a072191c41a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:08.644711 23823 raft_consensus.cc:2454] T e1e9a929f1fe4faeb8fc3a072191c41a P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 3.
I20260807 13:41:08.635455 23702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c1184114b02410098331e68d3b8d4cf" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:08.645722 23702 raft_consensus.cc:2454] T 7c1184114b02410098331e68d3b8d4cf P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 2.
I20260807 13:41:08.636708 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1099c0db8e4147fd86d0e1ba1162ab82" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:08.484302 25524 consensus_queue.cc:1046] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.107s
I20260807 13:41:08.618546 25475 raft_consensus.cc:686] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [term 6 LEADER]: Becoming Leader. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:08.635591 25476 raft_consensus.cc:3037] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:41:08.619230 25660 raft_consensus.cc:2726] T 8624086fc56b47cf914a4540b2ba3ae1 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:08.637302 25062 raft_consensus.cc:2781] T e912486c065f413cb2657340dc9a95af P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:41:08.619680 25408 raft_consensus.cc:482] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:08.630250 25600 raft_consensus.cc:3037] T cf2e5e45fca749498a80852c430edb21 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:08.654349 23711 raft_consensus.cc:2379] T 1099c0db8e4147fd86d0e1ba1162ab82 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 5: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:41:08.633885 25506 raft_consensus.cc:3037] T aa5fcc43292246d486ebba83eac423d6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:08.630842 25540 raft_consensus.cc:2781] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:08.666847 25540 raft_consensus.cc:482] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:08.667239 25540 raft_consensus.cc:3037] T 7e285d5ba5024cee8ad635138ef44fd5 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:08.641844 25158 raft_consensus.cc:3037] T 0dc716b3423f48deb7798cbf9e86d821 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:08.671314 25476 raft_consensus.cc:504] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:08.673468 25476 leader_election.cc:288] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 6 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:08.635812 25449 raft_consensus.cc:482] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:08.627951 25616 raft_consensus.cc:686] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:41:08.642163 25361 raft_consensus.cc:482] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:08.639415 24739 raft_consensus.cc:482] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8a3af1d071e74f2eb0c821e2bd68fe37)
I20260807 13:41:08.652225 23769 leader_election.cc:302] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:08.640136 25092 raft_consensus.cc:482] T 7a180725c9e34d0095ab423614678d88 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:08.661486 25524 raft_consensus.cc:3032] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:41:08.661368 25638 raft_consensus.cc:504] T 830e8cb8ce434e6391c09530c677a61d P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:08.662850 25446 raft_consensus.cc:3032] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:41:08.662743 25475 consensus_queue.cc:237] T 6c61756fb1434eeaa0f728ccb1894def P d28e736aee9f4f01b013de670a762697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:08.663371 25000 consensus_queue.cc:1035] T 1d0fa316c27e4c899031825c69b57f1d P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:41:08.663920 25408 raft_consensus.cc:3037] T 7800087414314b9983dee88fd1b6ccb5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:08.629990 25478 raft_consensus.cc:504] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:08.632884 25038 raft_consensus.cc:504] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:08.660961 23660 leader_election.cc:302] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:08.657122 23554 leader_election.cc:302] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812; no voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697
I20260807 13:41:08.647348 25571 raft_consensus.cc:2781] T 7a180725c9e34d0095ab423614678d88 P 08757cfbeffb41bbab14c2ef00e9d812 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:41:08.693288 23660 leader_election.cc:302] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters:
I20260807 13:41:08.699328 23711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92e077211c2d4b67b9560872e943322f" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:08.679067 25361 raft_consensus.cc:3037] T b8a6dd54ac4d4a8b9227a3d3ee9fafb6 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:41:08.680704 25092 raft_consensus.cc:3037] T 7a180725c9e34d0095ab423614678d88 P d28e736aee9f4f01b013de670a762697 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:41:08.682572 23699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e912486c065f413cb2657340dc9a95af" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:08.679648 23812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68ed0b32f1864122a6a9a014c0217c01" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:08.680219 25524 raft_consensus.cc:729] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:08.680470 25446 raft_consensus.cc:729] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:08.701246 23813 raft_consensus.cc:2379] T 92e077211c2d4b67b9560872e943322f P d28e736aee9f4f01b013de670a762697 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 6: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:41:08.685770 25476 raft_consensus.cc:2781] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:41:08.674593 25472 raft_consensus.cc:504] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:08.724546 25616 consensus_queue.cc:237] T 2f0a69bc60e24041b730133061e67069 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:08.725631 25446 consensus_queue.cc:260] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:08.727346 25472 leader_election.cc:288] T 689213e52b434d3bb11b840c79916a65 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 election: Requested vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:08.728137 25472 raft_consensus.cc:2726] T f8c48f8bcc0a41aa9267cc72e645a3ca P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:41:08.728024 25524 consensus_queue.cc:260] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:08.729401 25524 raft_consensus.cc:3037] T 966ce2c21a0a4a6cb65aaf5e0bfe8eac P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:08.722151 25476 raft_consensus.cc:482] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:41:08.730086 25476 raft_consensus.cc:3037] T 7c1184114b02410098331e68d3b8d4cf P d28e736aee9f4f01b013de670a762697 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:41:08.731249 23699 raft_consensus.cc:2379] T e912486c065f413cb2657340dc9a95af P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 5: Already voted for candidate 08757cfbeffb41bbab14c2ef00e9d812 in this term.
I20260807 13:41:08.712128 25681 raft_consensus.cc:482] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:08.734140 25681 raft_consensus.cc:504] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:08.736891 25654 raft_consensus.cc:3032] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:41:08.737273 25654 raft_consensus.cc:729] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d28e736aee9f4f01b013de670a762697, State: Running, Role: LEADER
I20260807 13:41:08.704588 24905 raft_consensus.cc:2781] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:41:08.679322 25449 raft_consensus.cc:504] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:08.681430 24739 raft_consensus.cc:504] T 4c6c66dd2185444995b276c0cf4000c8 P 08757cfbeffb41bbab14c2ef00e9d812 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:08.735539 25038 leader_election.cc:288] T f46f16bbd2f64224b67d0da4707f8f2f P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:08.746783 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47672 (request call id 820) took 1094 ms. Trace:
I20260807 13:41:08.747342 23700 rpcz_store.cc:276] 0807 13:41:07.652850 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:08.093340 (+440490us) service_pool.cc:227] Handling call
0807 13:41:08.093715 (+ 375us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:41:08.415255 (+321540us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:08.746402 (+331147us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b54000dded4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0adf51 00007f461c0ac99e 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86
0807 13:41:08.746691 (+ 289us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":737379584}
I20260807 13:41:08.682155 25677 consensus_queue.cc:237] T f46f16bbd2f64224b67d0da4707f8f2f P 8a3af1d071e74f2eb0c821e2bd68fe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:08.714754 25566 raft_consensus.cc:2781] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:41:08.738106 25654 consensus_queue.cc:260] T a47d160dba334fd0a32cff0cfc2459c1 P d28e736aee9f4f01b013de670a762697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
W20260807 13:41:08.771121 25700 log.cc:924] Time spent T 18a5485342aa448ba6cfe5f9c07eb43d P d28e736aee9f4f01b013de670a762697: Append to log took a long time: real 0.086s user 0.001s sys 0.000s
I20260807 13:41:08.772840 23815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ccbe9b13e784aaca48d07dff333695a" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:08.773633 23591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43820 (request call id 765) took 1054 ms. Trace:
I20260807 13:41:08.774029 23591 rpcz_store.cc:276] 0807 13:41:07.718833 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:07.928772 (+209939us) service_pool.cc:227] Handling call
0807 13:41:07.932451 (+ 3679us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:41:08.466246 (+533795us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:41:08.466275 (+ 29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:41:08.473855 (+ 7580us) log.cc:842] Serialized 26 byte log entry
0807 13:41:08.635824 (+161969us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:41:08.635885 (+ 61us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:08.635965 (+ 80us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:41:08.773416 (+137451us) raft_consensus.cc:1671] finished
0807 13:41:08.773443 (+ 27us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:41:08.773574 (+ 131us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":533445,"raft.queue_time_us":547622,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":6882,"thread_start_us":161671,"threads_started":1,"wal-append.queue_time_us":228539}
I20260807 13:41:08.740157 24905 raft_consensus.cc:482] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
W20260807 13:41:08.777818 23555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.82.66:38833, user_credentials={real_user=slave}} blocked reactor thread for 153644us
I20260807 13:41:08.760252 25446 raft_consensus.cc:3037] T 2f0a69bc60e24041b730133061e67069 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:08.773691 23815 raft_consensus.cc:2379] T 9ccbe9b13e784aaca48d07dff333695a P d28e736aee9f4f01b013de670a762697 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 6: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:41:08.764771 25566 raft_consensus.cc:482] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 08757cfbeffb41bbab14c2ef00e9d812)
I20260807 13:41:08.788044 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:08.792184 23700 raft_consensus.cc:2379] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d28e736aee9f4f01b013de670a762697 in current term 6: Already voted for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in this term.
I20260807 13:41:08.759424 25582 consensus_queue.cc:1046] T b8004e179e4945ada49709b2ebf227e7 P d28e736aee9f4f01b013de670a762697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260807 13:41:08.795725 23555 leader_election.cc:302] T 1ce8e1212162485cb6c2d7c393e99399 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:08.794196 23709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47680 (request call id 578) took 1012 ms. Trace:
I20260807 13:41:08.783960 24905 raft_consensus.cc:3037] T e1e9a929f1fe4faeb8fc3a072191c41a P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:41:08.794909 23820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45360 (request call id 728) took 2558 ms. Trace:
I20260807 13:41:08.797914 23709 rpcz_store.cc:276] 0807 13:41:07.781450 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:07.804498 (+ 23048us) service_pool.cc:227] Handling call
0807 13:41:08.794006 (+989508us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b540029f9d4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:41:08.794139 (+ 133us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1010680704}
I20260807 13:41:08.781551 25440 raft_consensus.cc:482] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:41:08.798048 23820 rpcz_store.cc:276] 0807 13:41:06.236976 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:06.919140 (+682164us) service_pool.cc:227] Handling call
0807 13:41:07.882364 (+963224us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:41:07.894396 (+ 12032us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:41:08.794724 (+900328us) spinlock_profiling.cc:243] Waited 963 ms on lock 0x7b5400225bd0. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0aca09 00007f4620fee2e9 00007f461a6d4684 00007f461a6d4612 00007f461a6d4541 00007f461a6d44bc 00007f461a6d3772 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:41:08.794858 (+ 134us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2214377728}
I20260807 13:41:08.788856 25622 leader_election.cc:288] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 6 election: Requested vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:08.789716 25566 raft_consensus.cc:3037] T 898f2485bfe34aa296ddf8f5c5cfb5ca P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:41:08.817571 23818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45360 (request call id 753) took 1133 ms. Trace:
I20260807 13:41:08.817631 23555 leader_election.cc:302] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08757cfbeffb41bbab14c2ef00e9d812, 8a3af1d071e74f2eb0c821e2bd68fe37; no voters:
I20260807 13:41:08.821695 23818 rpcz_store.cc:276] 0807 13:41:07.684569 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:41:07.685123 (+ 554us) service_pool.cc:227] Handling call
0807 13:41:08.817379 (+1132256us) spinlock_profiling.cc:243] Waited 586 ms on lock 0x7b540018f6d4. stack: 00007f4619153033 00007f4619152f30 00007f4618ab1534 00007f46227bd8b4 00007f46227bd849 00007f461c032471 00007f461c0b12ae 00007f4620feec27 00007f461a6d6c04 00007f461a6d6b92 00007f461a6d6ac1 00007f461a6d6a3c 00007f461a6d5cf2 00007f461a4d794c 00007f461a4d6d86 00007f461a4d672f
0807 13:41:08.817512 (+ 133us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1348434176}
I20260807 13:41:08.823208 23818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d905bf8af8b40f2b6cb105bf7d73ea5" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697"
I20260807 13:41:08.795149 25681 leader_election.cc:288] T e4d6a524bccf4e4a98f503c584d91cb3 P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), d28e736aee9f4f01b013de670a762697 (127.21.82.67:46685)
I20260807 13:41:08.823949 23818 raft_consensus.cc:2379] T 2d905bf8af8b40f2b6cb105bf7d73ea5 P d28e736aee9f4f01b013de670a762697 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in current term 6: Already voted for candidate d28e736aee9f4f01b013de670a762697 in this term.
I20260807 13:41:08.823868 23820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4d6a524bccf4e4a98f503c584d91cb3" candidate_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d28e736aee9f4f01b013de670a762697" is_pre_election: true
I20260807 13:41:08.823956 23660 leader_election.cc:302] T d82ae8b5e643448f937e62d82bf888ff P 8a3af1d071e74f2eb0c821e2bd68fe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37; no voters: 08757cfbeffb41bbab14c2ef00e9d812, d28e736aee9f4f01b013de670a762697
I20260807 13:41:08.825188 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "830e8cb8ce434e6391c09530c677a61d" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37"
I20260807 13:41:08.814682 25440 raft_consensus.cc:504] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:08.826740 23820 raft_consensus.cc:2454] T e4d6a524bccf4e4a98f503c584d91cb3 P d28e736aee9f4f01b013de670a762697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a3af1d071e74f2eb0c821e2bd68fe37 in term 4.
I20260807 13:41:08.831532 25440 leader_election.cc:288] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
I20260807 13:41:08.832020 25705 raft_consensus.cc:2781] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:41:08.832530 25705 raft_consensus.cc:686] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [term 5 LEADER]: Becoming Leader. State: Replica: 08757cfbeffb41bbab14c2ef00e9d812, State: Running, Role: LEADER
I20260807 13:41:08.833333 25705 consensus_queue.cc:237] T 72d879feba30417e9919fc152b543506 P 08757cfbeffb41bbab14c2ef00e9d812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08757cfbeffb41bbab14c2ef00e9d812" member_type: VOTER last_known_addr { host: "127.21.82.65" port: 33187 } } peers { permanent_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" member_type: VOTER last_known_addr { host: "127.21.82.66" port: 38833 } } peers { permanent_uuid: "d28e736aee9f4f01b013de670a762697" member_type: VOTER last_known_addr { host: "127.21.82.67" port: 46685 } }
I20260807 13:41:08.835425 25449 leader_election.cc:288] T 620e30fb1ff34164a7a4f66804acc719 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 08757cfbeffb41bbab14c2ef00e9d812 (127.21.82.65:33187), 8a3af1d071e74f2eb0c821e2bd68fe37 (127.21.82.66:38833)
@ 0x7f4615a8ac87 __libc_start_main at ??:0
@ 0x294389 (unknown) at ??:?
I20260807 13:41:08.845218 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b213bed392294fcfb09b79938e6b85b6" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:08.845942 23709 raft_consensus.cc:2454] T b213bed392294fcfb09b79938e6b85b6 P 8a3af1d071e74f2eb0c821e2bd68fe37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28e736aee9f4f01b013de670a762697 in term 5.
I20260807 13:41:08.846014 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620e30fb1ff34164a7a4f66804acc719" candidate_uuid: "d28e736aee9f4f01b013de670a762697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a3af1d071e74f2eb0c821e2bd68fe37" is_pre_election: true
I20260807 13:41:08.847949 23769 leader_election.cc:302] T b213bed392294fcfb09b79938e6b85b6 P d28e736aee9f4f01b013de670a762697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a3af1d071e74f2eb0c821e2bd68fe37, d28e736aee9f4f01b013de670a762697; no voters: